Jun 25 17:58:25 devstack cinder-volume[82515]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 25 17:58:25 devstack cinder-volume[82515]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 17:58:25 devstack cinder-volume[82515]: we strongly recommend against using it for new projects. Jun 25 17:58:25 devstack cinder-volume[82515]: If you are already using Eventlet, we recommend migrating to a different Jun 25 17:58:25 devstack cinder-volume[82515]: framework. For more detail see Jun 25 17:58:25 devstack cinder-volume[82515]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 17:58:25 devstack cinder-volume[82515]: import eventlet # noqa Jun 25 17:58:27 devstack cinder-volume[82515]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 17:58:27 devstack cinder-volume[82515]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 17:58:27 devstack cinder-volume[82515]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 17:58:28 devstack cinder-volume[82515]: INFO dbcounter [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Registered counter for database cinder Jun 25 17:58:28 devstack cinder-volume[82515]: DEBUG oslo_db.sqlalchemy.engines [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82515) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 17:58:28 devstack cinder-volume[82515]: DEBUG dbcounter [-] [82515] Writer thread running {{(pid=82515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 17:58:28 devstack cinder-volume[82515]: INFO cinder.rpc [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 25 17:58:28 devstack cinder-volume[82515]: INFO cinder.rpc [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 25 17:58:29 devstack cinder-volume[82515]: DEBUG oslo_db.sqlalchemy.engines [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82515) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 17:58:29 devstack cinder-volume[82515]: INFO cinder.volume.manager [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Determined volume DB was empty at startup. Jun 25 17:58:29 devstack cinder-volume[82515]: DEBUG cinder.volume.manager [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82515) __init__ /opt/stack/cinder/cinder/volume/manager.py:298}} Jun 25 17:58:29 devstack cinder-volume[82515]: INFO cinder.volume.manager [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 25 17:58:29 devstack cinder-volume[82515]: WARNING stevedore.named [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 25 17:58:29 devstack cinder-volume[82515]: WARNING castellan.key_manager [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 17:58:29 devstack cinder-volume[82515]: WARNING cinder.keymgr.conf_key_mgr [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 17:58:29 devstack cinder-volume[82515]: DEBUG cinder.volume.drivers.lvm [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82515) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 25 17:58:29 devstack cinder-volume[82515]: DEBUG oslo_concurrency.processutils [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:29 devstack cinder-volume[82515]: DEBUG oslo_concurrency.processutils [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] CMD "cinder-rtstool verify" returned: 0 in 0.533s {{(pid=82515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:29 devstack cinder-volume[82515]: DEBUG oslo_db.sqlalchemy.engines [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82515) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 17:58:29 devstack cinder-volume[82515]: INFO cinder.rpc [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 25 17:58:29 devstack cinder-volume[82515]: INFO cinder.rpc [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Automatically selected cinder-volume RPC version 3.21 as minimum service version. Jun 25 17:58:29 devstack cinder-volume[82515]: WARNING stevedore.named [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 25 17:58:29 devstack cinder-volume[82515]: WARNING castellan.key_manager [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 17:58:29 devstack cinder-volume[82515]: INFO cinder.volume.manager [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 25 17:58:29 devstack cinder-volume[82515]: DEBUG oslo_db.sqlalchemy.engines [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82515) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 17:58:30 devstack cinder-volume[82515]: INFO oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Starting 1 workers Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Started child 82694 {{(pid=82515) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Full set of CONF: {{(pid=82515) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] ******************************************************************************** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Configuration options gathered from: {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] ================================================================================ {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] allow_availability_zone_fallback = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] allow_compression_on_image_upload = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] allowed_direct_url_schemes = [] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] api_rate_limit = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] auth_strategy = keystone {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] az_cache_duration = 3600 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82694]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_availability_zone = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_host = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_name = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_stats_polling_interval = 60 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backup_api_class = cinder.backup.api.API {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backup_name_template = backup-%s {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backup_use_same_host = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backup_use_temp_snapshot = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] chap_password = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] chap_username = {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cinder_internal_tenant_project_id = f0f93730c02043e59059fe5f0443c548 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cinder_internal_tenant_user_id = 82bbd28565c14aaca476c7b20fbf5e49 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cloned_volume_same_az = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cluster = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] compression_format = gzip {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] compute_api_class = cinder.compute.nova.API {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] config_dir = [] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] config_source = [] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] control_exchange = openstack {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] debug = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] default_availability_zone = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] default_group_type = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] default_volume_type = lvmdriver-1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] disk_geometry = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] driver_client_cert = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] driver_client_cert_key = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] driver_data_namespace = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] driver_ssl_cert_path = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] driver_ssl_cert_verify = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] driver_use_ssl = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] enable_force_upload = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] enable_new_services = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] enable_unsupported_driver = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] enforce_multipath_for_image_xfer = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] filter_function = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance_api_insecure = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance_api_servers = ['http://192.168.122.170/image'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance_api_ssl_compression = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance_ca_certificates_file = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance_catalog_info = image:glance:publicURL {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance_certfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance_keyfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance_num_retries = 3 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance_request_timeout = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] goodness_function = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] graceful_shutdown_timeout = 5 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] group_api_class = cinder.group.api.API {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] host = devstack {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack sudo[82698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] image_compress_on_upload = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] image_conversion_address_space_limit = 1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] image_conversion_cpu_limit = 60 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] image_conversion_disable = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] image_upload_use_cinder_backend = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] image_upload_use_internal_tenant = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack sudo[82698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] image_volume_cache_enabled = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] image_volume_cache_max_count = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] image_volume_cache_max_size_gb = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] init_host_max_objects_retrieval = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] instance_format = [instance: %(uuid)s] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] iscsi_target_flags = {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] iscsi_write_cache = on {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82694]: INFO cinder.volume.manager [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] iser_helper = tgtadm {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] iser_ip_address = 192.168.122.170 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] iser_port = 3260 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] log_color = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] log_config_append = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] log_dir = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] log_file = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] log_options = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] log_rotate_interval = 1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] log_rotate_interval_type = days {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] log_rotation_type = none {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] max_age = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] max_logfile_count = 30 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] max_logfile_size_mb = 200 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] max_over_subscription_ratio = 20.0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] max_snapshots_per_migration = -1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] message_reap_interval = 86400 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] message_ttl = 2592000 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] migration_create_volume_timeout_secs = 300 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] monkey_patch = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] monkey_patch_modules = [] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] my_ip = 192.168.122.170 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] no_snapshot_gb_quota = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] num_iser_scan_tries = 3 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] num_shell_tries = 3 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] num_volume_device_scan_tries = 3 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] nvmeof_conn_info_version = 1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] nvmet_ns_id = 10 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] nvmet_port_id = 1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] osapi_max_limit = 1000 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] osapi_volume_ext_list = [] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] osapi_volume_listen_port = 8776 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] osapi_volume_use_ssl = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] osapi_volume_workers = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] per_volume_size_limit = -1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] periodic_fuzzy_delay = 60 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] periodic_interval = 60 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] public_endpoint = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] publish_errors = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] quota_backup_gigabytes = 1000 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] quota_backups = 10 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] quota_gigabytes = 1000 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] quota_groups = 10 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] quota_snapshots = 10 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] quota_volumes = 10 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] rate_limit_burst = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] rate_limit_except_level = CRITICAL {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] rate_limit_interval = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] reinit_driver_count = 3 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] replication_device = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:30 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] report_discard_supported = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] report_interval = 120 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] reservation_clean_interval = 86400 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] reservation_expire = 86400 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] reserved_image_namespaces = [] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] reserved_percentage = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] rpc_response_timeout = 120 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] run_external_periodic_tasks = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] scst_target_driver = iscsi {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] scst_target_iqn_name = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] service_down_time = 720 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] shell_completion = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] snapshot_name_template = snapshot-%s {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] snapshot_same_host = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] split_loggers = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] state_path = /opt/stack/data/cinder {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] storage_availability_zone = nova {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] storage_protocol = iSCSI {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] syslog_log_facility = LOG_USER {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] target_helper = lioadm {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] target_ip_address = 192.168.122.170 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] target_port = 3260 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] target_protocol = iscsi {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] target_secondary_ip_addresses = [] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] trace_flags = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] transport_url = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] until_refresh = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] use_chap_auth = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] use_default_quota_class = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] use_journal = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] use_json = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] use_multipath_for_image_xfer = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] use_stderr = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] use_syslog = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] verify_glance_signatures = enabled {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] volume_api_class = cinder.volume.api.API {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] volume_backend_name = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] volume_clear = zero {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] volume_clear_ionice = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] volume_clear_size = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] volume_copy_bps_limit = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] volume_dd_blocksize = 1M {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] volume_name_template = volume-%s {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] volume_service_inithost_offload = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] volume_usage_audit_period = month {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] zoning_mode = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_concurrency.disable_process_locking = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.auth_section = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.auth_type = password {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.auth_version = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.cache = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.certfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.include_service_catalog = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.insecure = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.interface = public {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.keyfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_password = {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcache_username = {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.region_name = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.service_type = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.170/identity {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.backend = dogpile.cache.null {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.backend_argument = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.backend_expiration_time = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.config_prefix = cache.oslo {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.debug_cache_backend = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.enable_retry_client = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.enable_socket_keepalive = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.enabled = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.expiration_time = 600 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.hashclient_retry_attempts = 2 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.memcache_dead_retry = 300 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.memcache_pool_maxsize = 10 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.memcache_sasl_enabled = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.password = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.proxies = [] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.redis_db = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.redis_server = localhost:6379 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.retry_attempts = 2 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.retry_delay = 0.0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.socket_keepalive_count = 1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.socket_keepalive_idle = 1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.socket_keepalive_interval = 1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.socket_timeout = 1.0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.tls_allowed_ciphers = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.tls_cafile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.tls_certfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.tls_enabled = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.tls_keyfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cache.username = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] coordination.backend_url = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.asyncio_connection = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.asyncio_slave_connection = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.backend = sqlalchemy {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.connection = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.connection_debug = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.connection_parameters = {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.connection_recycle_time = 3600 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.connection_trace = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.db_inc_retry_interval = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.db_max_retries = 20 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.db_max_retry_interval = 10 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.db_retry_interval = 1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.max_overflow = 50 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.max_pool_size = 5 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.max_retries = 10 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.mysql_wsrep_sync_wait = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.pool_timeout = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.retry_interval = 10 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.slave_connection = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.sqlite_synchronous = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.synchronous_reader = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] database.use_db_reconnect = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] profiler.connection_string = messaging:// {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] profiler.enabled = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] profiler.es_doc_type = notification {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] profiler.es_scroll_size = 10000 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] profiler.es_scroll_time = 2m {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] profiler.filter_error_trace = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] profiler.hmac_keys = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] profiler.sentinel_service_name = mymaster {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] profiler.socket_timeout = 0.1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] profiler.trace_requests = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] profiler.trace_sqlalchemy = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] profiler_jaeger.process_tags = {} {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] profiler_jaeger.service_name_prefix = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] profiler_otlp.service_name_prefix = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_policy.enforce_new_defaults = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: WARNING oslo_config.cfg [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_policy.enforce_scope = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_policy.policy_default_rule = default {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_policy.policy_file = policy.yaml {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] privsep_osbrick.group = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] privsep_osbrick.helper_command = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] privsep_osbrick.user = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cinder_sys_admin.group = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cinder_sys_admin.helper_command = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] cinder_sys_admin.user = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] service_user.auth_section = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] service_user.auth_type = password {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] service_user.cafile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] service_user.certfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] service_user.collect_timing = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] service_user.insecure = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] service_user.keyfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] service_user.send_service_user_token = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] service_user.split_loggers = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] service_user.timeout = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance.auth_section = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance.auth_type = password {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance.certfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance.collect_timing = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance.insecure = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance.keyfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance.region_name = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance.split_loggers = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] glance.timeout = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.backend_availability_zone = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.chap_password = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.chap_username = {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.disk_geometry = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.driver_client_cert = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.driver_client_cert_key = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.driver_data_namespace = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.driver_use_ssl = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.extra_capabilities = {} {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.filter_function = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.goodness_function = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.iscsi_target_flags = {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.iscsi_write_cache = on {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.iser_helper = tgtadm {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.iser_ip_address = 192.168.122.170 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.iser_port = 3260 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.lvm_share_target = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.lvm_type = auto {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.num_shell_tries = 3 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.replication_device = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.report_discard_supported = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.reserved_percentage = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.target_helper = tgtadm {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.target_ip_address = 192.168.122.170 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.target_port = 3260 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.target_protocol = iscsi {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.trace_flags = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.unique_fqdn_network = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.use_chap_auth = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.volume_backend_name = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.volume_clear = zero {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.volume_clear_ionice = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.volume_clear_size = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_reports.file_event_handler = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_reports.log_dir = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.backend_host = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.chap_password = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.chap_username = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.disk_geometry = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.driver_client_cert = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.extra_capabilities = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.filter_function = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.goodness_function = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.iser_helper = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.iser_ip_address = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.iser_port = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.lvm_share_target = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.lvm_type = auto {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.num_shell_tries = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.replication_device = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.report_discard_supported = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.reserved_percentage = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.scst_target_driver = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.storage_protocol = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.target_helper = lioadm {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.target_ip_address = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.target_port = 3260 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.trace_flags = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.use_chap_auth = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.volume_clear = zero {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.volume_clear_size = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] lvmdriver-1.volumes_dir = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.ssl = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_notifications.driver = [] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_notifications.retry = -1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] key_manager.fixed_key = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.barbican_api_version = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.barbican_endpoint = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.barbican_endpoint_type = public {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.barbican_region_name = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.cafile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.certfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.collect_timing = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.insecure = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.keyfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.number_of_retries = 60 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.retry_delay = 1 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.send_service_user_token = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.split_loggers = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.timeout = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.verify_ssl = True {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican.verify_ssl_path = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican_service_user.auth_section = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican_service_user.auth_type = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican_service_user.cafile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican_service_user.certfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican_service_user.collect_timing = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican_service_user.insecure = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican_service_user.keyfile = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican_service_user.split_loggers = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] barbican_service_user.timeout = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] vault.approle_role_id = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] vault.approle_secret_id = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] vault.kv_mountpoint = secret {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] vault.kv_path = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] vault.kv_version = 2 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] vault.namespace = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] vault.root_token_id = **** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] vault.ssl_ca_crt_file = None {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] vault.timeout = 60.0 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] vault.use_ssl = False {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:58:30 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] ******************************************************************************** {{(pid=82515) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 25 17:58:30 devstack sudo[82698]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:30 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.828s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:30 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:30 devstack sudo[82782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 17:58:30 devstack sudo[82782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:31 devstack sudo[82782]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:31 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.704s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:31 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:58:31 devstack cinder-volume[82694]: INFO cinder.brick.local_dev.lvm [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 25 17:58:31 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:31 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:31 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:31 devstack sudo[83082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 17:58:31 devstack sudo[83082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:32 devstack sudo[83082]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:32 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.812s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:32 devstack cinder-volume[82694]: DEBUG cinder.brick.local_dev.lvm [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82694) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 25 17:58:32 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:32 devstack sudo[83265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 17:58:32 devstack sudo[83265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:33 devstack sudo[83265]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:33 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.099s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:33 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:33 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:33 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:33 devstack sudo[83473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 17:58:33 devstack sudo[83473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:34 devstack sudo[83473]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:34 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.773s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:34 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:34 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:34 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:34 devstack sudo[83478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 25 17:58:34 devstack sudo[83478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:35 devstack sudo[83478]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:35 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.861s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:35 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:35 devstack sudo[83483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 17:58:35 devstack sudo[83483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:36 devstack sudo[83483]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:36 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.952s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:36 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:36 devstack sudo[83488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 17:58:36 devstack sudo[83488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:37 devstack sudo[83488]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:37 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.965s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:37 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:37 devstack sudo[83500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 17:58:37 devstack sudo[83500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:38 devstack sudo[83500]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:38 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.086s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:38 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:38 devstack sudo[83507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 17:58:38 devstack sudo[83507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:38 devstack sudo[83507]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:38 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.687s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:38 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:39 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:39 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:39 devstack sudo[83517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 17:58:39 devstack sudo[83517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:39 devstack sudo[83517]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:39 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.811s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:39 devstack cinder-volume[82694]: INFO cinder.volume.drivers.lvm [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 25 17:58:39 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:39 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:39 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:39 devstack sudo[83635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 17:58:39 devstack sudo[83635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:40 devstack cinder-volume[82515]: DEBUG dbcounter [-] [82515] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:58:40 devstack sudo[83635]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:40 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.851s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:40 devstack cinder-volume[82694]: DEBUG cinder.volume.drivers.lvm [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Updating volume stats {{(pid=82694) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 17:58:40 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:40 devstack sudo[83779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 17:58:40 devstack sudo[83779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:41 devstack sudo[83779]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:41 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:41 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:41 devstack sudo[83782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 17:58:41 devstack sudo[83782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:42 devstack sudo[83782]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:42 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:42 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:42 devstack sudo[83785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 17:58:42 devstack sudo[83785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:42 devstack sudo[83785]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:42 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.709s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:42 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:42 devstack sudo[83788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 17:58:42 devstack sudo[83788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:43 devstack sudo[83788]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:43 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:43 devstack cinder-volume[82694]: INFO cinder.volume.driver [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Driver hasn't implemented _init_vendor_properties() Jun 25 17:58:43 devstack cinder-volume[82694]: DEBUG cinder.volume.driver [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82694) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 25 17:58:43 devstack cinder-volume[82694]: DEBUG oslo_db.sqlalchemy.engines [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82694) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 17:58:43 devstack cinder-volume[82694]: DEBUG dbcounter [-] [82694] Writer thread running {{(pid=82694) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 17:58:43 devstack cinder-volume[82694]: DEBUG cinder.db.api [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Building query based on filter {{(pid=82694) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 25 17:58:43 devstack cinder-volume[82694]: DEBUG cinder.image.image_utils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82694) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 25 17:58:43 devstack cinder-volume[82694]: INFO cinder.keymgr.migration [None req-9acd6f23-12e1-49c4-8c2c-4e7088daf9a5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 25 17:58:43 devstack cinder-volume[82694]: DEBUG cinder.volume.drivers.lvm [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Updating volume stats {{(pid=82694) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 17:58:43 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:43 devstack sudo[83795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 17:58:43 devstack sudo[83795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:44 devstack sudo[83795]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:44 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:44 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:44 devstack sudo[83802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 17:58:44 devstack sudo[83802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:44 devstack sudo[83802]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:44 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:44 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:44 devstack sudo[83809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 17:58:44 devstack sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:45 devstack sudo[83809]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:45 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.668s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:45 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:45 devstack sudo[83812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 17:58:45 devstack sudo[83812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:46 devstack sudo[83812]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:46 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.702s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:46 devstack cinder-volume[82694]: DEBUG cinder.manager [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Notifying Schedulers of capabilities ... {{(pid=82694) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:58:46 devstack cinder-volume[82694]: INFO cinder.volume.manager [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Driver initialization completed successfully. Jun 25 17:58:46 devstack cinder-volume[82694]: INFO cinder.manager [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Initiating service 2 cleanup Jun 25 17:58:46 devstack cinder-volume[82694]: INFO cinder.manager [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Service 2 cleanup completed. Jun 25 17:58:46 devstack cinder-volume[82694]: DEBUG cinder.service [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Creating RPC server for service cinder-volume {{(pid=82694) start /opt/stack/cinder/cinder/service.py:231}} Jun 25 17:58:46 devstack cinder-volume[82694]: DEBUG cinder.service [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82694) start /opt/stack/cinder/cinder/service.py:237}} Jun 25 17:58:46 devstack cinder-volume[82694]: INFO cinder.volume.manager [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 25 17:58:46 devstack cinder-volume[82694]: DEBUG cinder.volume.drivers.lvm [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Updating volume stats {{(pid=82694) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 17:58:46 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:46 devstack sudo[83816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 17:58:46 devstack sudo[83816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:47 devstack sudo[83816]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:47 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.709s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:47 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:47 devstack sudo[83820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 17:58:47 devstack sudo[83820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:47 devstack sudo[83820]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:47 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:47 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:47 devstack sudo[83877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 17:58:47 devstack sudo[83877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:48 devstack sudo[83877]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:48 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.663s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:48 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:58:48 devstack sudo[83883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 17:58:48 devstack sudo[83883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:58:49 devstack sudo[83883]: pam_unix(sudo:session): session closed for user root Jun 25 17:58:49 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:58:49 devstack cinder-volume[82694]: INFO cinder.volume.manager [None req-a244aed8-1d05-4cce-b610-07a8f4f379ef None None] Driver post RPC initialization completed successfully. Jun 25 17:58:56 devstack cinder-volume[82694]: DEBUG dbcounter [-] [82694] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82694) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:58:59 devstack cinder-volume[82694]: DEBUG dbcounter [-] [82694] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82694) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:59:22 devstack cinder-volume[82694]: DEBUG oslo_service.periodic_task [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running periodic task VolumeManager._thread_info {{(pid=82694) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:59:22 devstack cinder-volume[82694]: DEBUG cinder.volume.manager [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] thread count: 6 {{(pid=82694) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 17:59:22 devstack cinder-volume[82694]: DEBUG cinder.volume.manager [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] thread info: [<_MainThread(MainThread, started 127498363646080)>, , , , , ] {{(pid=82694) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:00:22 devstack cinder-volume[82694]: DEBUG oslo_service.periodic_task [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82694) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:00:22 devstack cinder-volume[82694]: DEBUG cinder.volume.drivers.lvm [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Updating volume stats {{(pid=82694) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 18:00:22 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:22 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 18:00:22 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:00:22 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Jun 25 18:00:22 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.734s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:22 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:22 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:00:22 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:00:23 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Jun 25 18:00:23 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.711s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:23 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:23 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:00:23 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:00:24 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Jun 25 18:00:24 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:24 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:00:24 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:00:24 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:00:24 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Jun 25 18:00:24 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:00:24 devstack cinder-volume[82694]: DEBUG cinder.manager [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Notifying Schedulers of capabilities ... {{(pid=82694) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:00:24 devstack cinder-volume[82694]: DEBUG oslo_service.periodic_task [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running periodic task VolumeManager._thread_info {{(pid=82694) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:00:24 devstack cinder-volume[82694]: DEBUG cinder.volume.manager [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] thread count: 6 {{(pid=82694) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:00:24 devstack cinder-volume[82694]: DEBUG cinder.volume.manager [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] thread info: [<_MainThread(MainThread, started 127498363646080)>, , , , , ] {{(pid=82694) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:00:59 devstack cinder-volume[82694]: DEBUG dbcounter [-] [82694] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82694) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:01:22 devstack cinder-volume[82694]: DEBUG oslo_service.periodic_task [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82694) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:01:22 devstack cinder-volume[82694]: DEBUG cinder.volume.drivers.lvm [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Updating volume stats {{(pid=82694) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 18:01:22 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:22 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 18:01:22 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:22 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:22 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.717s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:22 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:22 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:01:22 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:23 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:23 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.718s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:23 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:23 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:01:23 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:24 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:24 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.721s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:24 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:01:24 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:01:24 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:01:25 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Jun 25 18:01:25 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:01:25 devstack cinder-volume[82694]: DEBUG cinder.manager [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Notifying Schedulers of capabilities ... {{(pid=82694) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:01:25 devstack cinder-volume[82694]: DEBUG oslo_service.periodic_task [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running periodic task VolumeManager._thread_info {{(pid=82694) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:01:25 devstack cinder-volume[82694]: DEBUG cinder.volume.manager [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] thread count: 6 {{(pid=82694) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:01:25 devstack cinder-volume[82694]: DEBUG cinder.volume.manager [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] thread info: [<_MainThread(MainThread, started 127498363646080)>, , , , , ] {{(pid=82694) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:02:22 devstack cinder-volume[82694]: DEBUG oslo_service.periodic_task [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82694) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:02:22 devstack cinder-volume[82694]: DEBUG cinder.volume.drivers.lvm [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Updating volume stats {{(pid=82694) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 18:02:22 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:02:22 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 18:02:22 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:02:22 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Jun 25 18:02:22 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:02:22 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:02:22 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:02:22 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:02:23 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Jun 25 18:02:23 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:02:23 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:02:23 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:02:23 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:02:24 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Jun 25 18:02:24 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.649s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:02:24 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:02:24 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:02:24 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:02:24 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Jun 25 18:02:24 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:02:24 devstack cinder-volume[82694]: DEBUG cinder.manager [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Notifying Schedulers of capabilities ... {{(pid=82694) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:02:24 devstack cinder-volume[82694]: DEBUG oslo_service.periodic_task [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running periodic task VolumeManager._thread_info {{(pid=82694) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:02:24 devstack cinder-volume[82694]: DEBUG cinder.volume.manager [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] thread count: 6 {{(pid=82694) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:02:24 devstack cinder-volume[82694]: DEBUG cinder.volume.manager [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] thread info: [<_MainThread(MainThread, started 127498363646080)>, , , , , ] {{(pid=82694) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:02:59 devstack cinder-volume[82694]: DEBUG dbcounter [-] [82694] Writing DB stats cinder:SELECT=1 {{(pid=82694) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:02:59 devstack cinder-volume[82694]: DEBUG dbcounter [-] [82694] Writing DB stats cinder:UPDATE=1 {{(pid=82694) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:03:22 devstack cinder-volume[82694]: DEBUG oslo_service.periodic_task [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82694) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:03:22 devstack cinder-volume[82694]: DEBUG cinder.volume.drivers.lvm [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Updating volume stats {{(pid=82694) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 18:03:22 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:03:22 devstack sudo[92070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 18:03:22 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:03:22 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root Jun 25 18:03:22 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.752s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:03:22 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:03:22 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:03:22 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:03:23 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Jun 25 18:03:23 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:03:23 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:03:23 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 18:03:23 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:03:24 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Jun 25 18:03:24 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:03:24 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:03:24 devstack sudo[92116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 18:03:24 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:03:25 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root Jun 25 18:03:25 devstack cinder-volume[82694]: DEBUG oslo_concurrency.processutils [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.734s {{(pid=82694) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:03:25 devstack cinder-volume[82694]: DEBUG cinder.manager [None req-99d75d50-a865-4b39-8a31-50e6a2ba2ffb None None] Notifying Schedulers of capabilities ... {{(pid=82694) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:03:51 devstack cinder-volume[82515]: INFO oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Caught SIGTERM, stopping children Jun 25 18:03:51 devstack cinder-volume[82515]: DEBUG oslo_concurrency.lockutils [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Acquiring lock "singleton_lock" {{(pid=82515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 18:03:51 devstack cinder-volume[82515]: DEBUG oslo_concurrency.lockutils [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Acquired lock "singleton_lock" {{(pid=82515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 18:03:51 devstack cinder-volume[82515]: DEBUG oslo_concurrency.lockutils [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Releasing lock "singleton_lock" {{(pid=82515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 18:03:51 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Stop services. {{(pid=82515) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 25 18:03:51 devstack cinder-volume[82515]: DEBUG oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Killing children. {{(pid=82515) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 25 18:03:51 devstack cinder-volume[82515]: INFO oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Waiting on 1 children to exit Jun 25 18:03:56 devstack cinder-volume[82694]: DEBUG oslo_concurrency.lockutils [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Acquiring lock "singleton_lock" {{(pid=82694) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 18:03:56 devstack cinder-volume[82694]: DEBUG oslo_concurrency.lockutils [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Acquired lock "singleton_lock" {{(pid=82694) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 18:03:56 devstack cinder-volume[82694]: DEBUG oslo_concurrency.lockutils [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Releasing lock "singleton_lock" {{(pid=82694) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 18:03:56 devstack cinder-volume[82694]: WARNING amqp [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 25 18:03:56 devstack cinder-volume[82694]: WARNING amqp [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 25 18:03:56 devstack cinder-volume[82515]: INFO oslo_service.backend._eventlet.service [None req-427b2a08-d541-4039-a80c-dcb79fa7c228 None None] Child 82694 exited with status 0 Jun 25 18:03:56 devstack cinder-volume[92798]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 25 18:03:56 devstack cinder-volume[92798]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 18:03:56 devstack cinder-volume[92798]: we strongly recommend against using it for new projects. Jun 25 18:03:56 devstack cinder-volume[92798]: If you are already using Eventlet, we recommend migrating to a different Jun 25 18:03:56 devstack cinder-volume[92798]: framework. For more detail see Jun 25 18:03:56 devstack cinder-volume[92798]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 18:03:56 devstack cinder-volume[92798]: import eventlet # noqa Jun 25 18:03:58 devstack cinder-volume[92798]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92798) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 18:03:58 devstack cinder-volume[92798]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92798) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 18:03:58 devstack cinder-volume[92798]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92798) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 18:03:59 devstack cinder-volume[92798]: INFO dbcounter [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Registered counter for database cinder Jun 25 18:03:59 devstack cinder-volume[92798]: DEBUG oslo_db.sqlalchemy.engines [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92798) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:03:59 devstack cinder-volume[92798]: DEBUG dbcounter [-] [92798] Writer thread running {{(pid=92798) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 18:04:00 devstack cinder-volume[92798]: INFO cinder.rpc [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 25 18:04:00 devstack cinder-volume[92798]: INFO cinder.rpc [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_db.sqlalchemy.engines [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92798) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:04:00 devstack cinder-volume[92798]: INFO cinder.volume.manager [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Determined volume DB was empty at startup. Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG cinder.volume.manager [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92798) __init__ /opt/stack/cinder/cinder/volume/manager.py:298}} Jun 25 18:04:00 devstack cinder-volume[92798]: INFO cinder.volume.manager [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 25 18:04:00 devstack cinder-volume[92798]: WARNING stevedore.named [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 25 18:04:00 devstack cinder-volume[92798]: WARNING castellan.key_manager [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 18:04:00 devstack cinder-volume[92798]: WARNING cinder.keymgr.conf_key_mgr [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 18:04:00 devstack cinder-volume[92798]: INFO cinder.volume.manager [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_db.sqlalchemy.engines [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92798) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:04:00 devstack cinder-volume[92798]: INFO oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Starting 1 workers Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Started child 93026 {{(pid=92798) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Full set of CONF: {{(pid=92798) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] ******************************************************************************** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Configuration options gathered from: {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] ================================================================================ {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] allow_availability_zone_fallback = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] allow_compression_on_image_upload = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] allowed_direct_url_schemes = [] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] api_rate_limit = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] auth_strategy = keystone {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_availability_zone = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_host = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_name = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_stats_polling_interval = 60 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backup_api_class = cinder.backup.api.API {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[93026]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backup_name_template = backup-%s {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backup_use_same_host = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backup_use_temp_snapshot = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] chap_password = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] chap_username = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cinder_internal_tenant_project_id = f0f93730c02043e59059fe5f0443c548 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cinder_internal_tenant_user_id = 82bbd28565c14aaca476c7b20fbf5e49 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cluster = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] compression_format = gzip {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] compute_api_class = cinder.compute.nova.API {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] config_dir = [] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] config_source = [] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] control_exchange = openstack {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] debug = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] default_availability_zone = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] default_group_type = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] default_volume_type = QuobyteHD {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] disk_geometry = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] driver_client_cert = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] driver_client_cert_key = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] driver_data_namespace = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] driver_ssl_cert_path = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] driver_ssl_cert_verify = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] driver_use_ssl = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] enable_new_services = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] enable_unsupported_driver = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] enabled_backends = ['QuobyteHD'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] enforce_multipath_for_image_xfer = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] filter_function = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance_api_insecure = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance_api_servers = ['http://192.168.122.170/image'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance_api_ssl_compression = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance_ca_certificates_file = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance_catalog_info = image:glance:publicURL {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance_certfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance_keyfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance_num_retries = 3 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance_request_timeout = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] goodness_function = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] graceful_shutdown_timeout = 5 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] group_api_class = cinder.group.api.API {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] host = devstack {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] image_compress_on_upload = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] image_conversion_address_space_limit = 1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] image_conversion_cpu_limit = 60 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] image_conversion_disable = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] image_upload_use_cinder_backend = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] image_upload_use_internal_tenant = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] image_volume_cache_enabled = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] image_volume_cache_max_count = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] image_volume_cache_max_size_gb = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] init_host_max_objects_retrieval = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] instance_format = [instance: %(uuid)s] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] iscsi_target_flags = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] iscsi_write_cache = on {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] iser_helper = tgtadm {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] iser_ip_address = 192.168.122.170 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] iser_port = 3260 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] log_color = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] log_config_append = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] log_dir = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] log_file = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] log_options = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] log_rotate_interval = 1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] log_rotate_interval_type = days {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] log_rotation_type = none {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] max_age = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] max_logfile_count = 30 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] max_logfile_size_mb = 200 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] max_over_subscription_ratio = 20.0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] message_reap_interval = 86400 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] message_ttl = 2592000 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] migration_create_volume_timeout_secs = 300 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] monkey_patch = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] monkey_patch_modules = [] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] my_ip = 192.168.122.170 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] no_snapshot_gb_quota = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] num_iser_scan_tries = 3 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] num_shell_tries = 3 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] num_volume_device_scan_tries = 3 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] nvmeof_conn_info_version = 1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] nvmet_ns_id = 10 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] nvmet_port_id = 1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] osapi_max_limit = 1000 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] osapi_volume_ext_list = [] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] osapi_volume_listen = 0.0.0.0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] osapi_volume_listen_port = 8776 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] osapi_volume_use_ssl = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] osapi_volume_workers = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] per_volume_size_limit = -1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] periodic_fuzzy_delay = 60 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] periodic_interval = 60 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] project_id_regex = [0-9a-f\-]+ {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] public_endpoint = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] publish_errors = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] quota_backup_gigabytes = 1000 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] quota_backups = 10 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] quota_gigabytes = 1000 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] quota_groups = 10 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] quota_snapshots = 10 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] quota_volumes = 10 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] rate_limit_burst = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] rate_limit_except_level = CRITICAL {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] rate_limit_interval = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] reinit_driver_count = 3 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] replication_device = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] report_discard_supported = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] report_interval = 120 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] reservation_clean_interval = 86400 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] reservation_expire = 86400 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] reserved_image_namespaces = [] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] reserved_percentage = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] rpc_response_timeout = 120 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] run_external_periodic_tasks = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] scst_target_driver = iscsi {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] scst_target_iqn_name = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] service_down_time = 720 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] shell_completion = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] snapshot_name_template = snapshot-%s {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] split_loggers = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] state_path = /opt/stack/data/cinder {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] storage_availability_zone = nova {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] storage_protocol = iSCSI {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] syslog_log_facility = LOG_USER {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] target_helper = lioadm {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] target_ip_address = 192.168.122.170 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] target_port = 3260 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] target_protocol = iscsi {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] target_secondary_ip_addresses = [] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] trace_flags = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] transfer_api_class = cinder.transfer.api.API {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] transport_url = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] until_refresh = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] use_chap_auth = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[93026]: INFO cinder.volume.manager [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] use_default_quota_class = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[93026]: DEBUG cinder.volume.drivers.remotefs [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93026) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] use_journal = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] use_json = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] use_multipath_for_image_xfer = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] use_stderr = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] use_syslog = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] verify_glance_signatures = enabled {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] volume_api_class = cinder.volume.api.API {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] volume_backend_name = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] volume_clear = zero {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] volume_clear_ionice = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] volume_clear_size = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] volume_copy_bps_limit = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] volume_dd_blocksize = 1M {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] volume_name_template = volume-%s {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] volume_service_inithost_offload = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] volume_usage_audit_period = month {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] zoning_mode = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_concurrency.disable_process_locking = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.auth_section = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.auth_type = password {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.auth_version = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.cache = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.certfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.delay_auth_decision = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.http_connect_timeout = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.include_service_catalog = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.insecure = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.interface = public {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.keyfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_password = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcache_username = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.region_name = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.service_token_roles_required = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.service_type = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.token_cache_time = 300 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.170/identity {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.backend = dogpile.cache.null {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.backend_argument = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.backend_expiration_time = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.config_prefix = cache.oslo {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.debug_cache_backend = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.enable_retry_client = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.enable_socket_keepalive = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.enabled = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.expiration_time = 600 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.hashclient_retry_attempts = 2 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.memcache_dead_retry = 300 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.memcache_pool_maxsize = 10 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.memcache_sasl_enabled = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.password = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.proxies = [] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.redis_db = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.redis_sentinel_service_name = mymaster {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.redis_server = localhost:6379 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.retry_attempts = 2 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.retry_delay = 0.0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.socket_keepalive_count = 1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.socket_keepalive_idle = 1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.socket_keepalive_interval = 1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.socket_timeout = 1.0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.tls_allowed_ciphers = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.tls_cafile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.tls_certfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.tls_enabled = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.tls_keyfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cache.username = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] coordination.backend_url = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.asyncio_connection = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.asyncio_slave_connection = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.backend = sqlalchemy {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.connection = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.connection_debug = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.connection_parameters = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.connection_recycle_time = 3600 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.connection_trace = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.db_inc_retry_interval = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.db_max_retries = 20 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.db_max_retry_interval = 10 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.db_retry_interval = 1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.max_overflow = 50 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.max_pool_size = 5 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.max_retries = 10 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.mysql_wsrep_sync_wait = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.pool_timeout = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.retry_interval = 10 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.slave_connection = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.sqlite_synchronous = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.synchronous_reader = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] database.use_db_reconnect = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] profiler.connection_string = messaging:// {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] profiler.enabled = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] profiler.es_doc_type = notification {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] profiler.es_scroll_size = 10000 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] profiler.es_scroll_time = 2m {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] profiler.filter_error_trace = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] profiler.hmac_keys = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] profiler.sentinel_service_name = mymaster {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] profiler.socket_timeout = 0.1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] profiler.trace_requests = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] profiler.trace_sqlalchemy = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] profiler_jaeger.process_tags = {} {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] profiler_jaeger.service_name_prefix = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] profiler_otlp.service_name_prefix = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_policy.enforce_new_defaults = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: WARNING oslo_config.cfg [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_policy.enforce_scope = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_policy.policy_default_rule = default {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_policy.policy_file = policy.yaml {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_policy.remote_timeout = 60.0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] privsep_osbrick.group = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] privsep_osbrick.helper_command = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] privsep_osbrick.user = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cinder_sys_admin.group = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cinder_sys_admin.helper_command = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] cinder_sys_admin.user = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] service_user.auth_section = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] service_user.auth_type = password {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] service_user.cafile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] service_user.certfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] service_user.collect_timing = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] service_user.insecure = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] service_user.keyfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] service_user.send_service_user_token = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] service_user.split_loggers = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] service_user.timeout = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance.auth_section = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance.auth_type = password {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance.certfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance.collect_timing = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance.insecure = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance.keyfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance.region_name = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance.split_loggers = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] glance.timeout = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.backend_availability_zone = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.chap_password = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.chap_username = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.disk_geometry = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.driver_client_cert = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.driver_client_cert_key = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.driver_data_namespace = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.driver_use_ssl = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.enable_unsupported_driver = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.extra_capabilities = {} {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.filter_function = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.goodness_function = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.iscsi_target_flags = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.iscsi_write_cache = on {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.iser_helper = tgtadm {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.iser_ip_address = 192.168.122.170 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.iser_port = 3260 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.nas_host = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.nas_login = admin {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.nas_mount_options = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.nas_password = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.nas_private_key = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.nas_share_path = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.nas_ssh_port = 22 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.num_shell_tries = 3 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.nvmet_port_id = 1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.quobyte_client_cfg = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.quobyte_volume_url = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.replication_device = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.report_discard_supported = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.reserved_percentage = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.scst_target_driver = iscsi {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.scst_target_iqn_name = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.storage_protocol = iSCSI {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.target_helper = tgtadm {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.target_ip_address = 192.168.122.170 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.target_port = 3260 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.target_protocol = iscsi {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.trace_flags = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.unique_fqdn_network = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.use_chap_auth = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.volume_backend_name = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.volume_clear = zero {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.volume_clear_ionice = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.volume_clear_size = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_reports.file_event_handler = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_reports.log_dir = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.backend_availability_zone = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.backend_host = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.chap_password = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.chap_username = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.chiscsi_conf = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.disk_geometry = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.driver_client_cert = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.driver_client_cert_key = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.driver_data_namespace = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.driver_use_ssl = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.extra_capabilities = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.filter_function = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.goodness_function = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.iscsi_target_flags = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.iscsi_write_cache = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.iser_helper = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[93026]: DEBUG cinder.volume.drivers.quobyte [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93026) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.iser_ip_address = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.iser_port = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.iser_target_prefix = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.nas_host = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.nas_login = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.nas_mount_options = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.nas_password = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.nas_private_key = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.nas_share_path = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.nas_ssh_port = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.num_shell_tries = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.nvmet_ns_id = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.nvmet_port_id = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.replication_device = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.report_discard_supported = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.reserved_percentage = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.scst_target_driver = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[93026]: WARNING cinder.volume.drivers.quobyte [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 25 18:04:00 devstack cinder-volume[93026]: WARNING cinder.volume.drivers.quobyte [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.storage_protocol = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.target_helper = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[93026]: DEBUG oslo_concurrency.processutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Running cmd (subprocess): mount.quobyte {{(pid=93026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.target_ip_address = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.target_port = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.target_prefix = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.target_protocol = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.trace_flags = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.unique_fqdn_network = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.use_chap_auth = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.volume_clear = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.volume_clear_ionice = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.volume_clear_size = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] QuobyteHD.volumes_dir = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.ssl = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.ssl_version = {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_notifications.driver = [] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_notifications.retry = -1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] oslo_messaging_notifications.transport_url = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] key_manager.fixed_key = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.barbican_api_version = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.barbican_endpoint = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.barbican_endpoint_type = public {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.barbican_region_name = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.cafile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.certfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.collect_timing = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.insecure = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.keyfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.number_of_retries = 60 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.retry_delay = 1 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.send_service_user_token = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.split_loggers = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.timeout = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.verify_ssl = True {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican.verify_ssl_path = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican_service_user.auth_section = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican_service_user.auth_type = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican_service_user.cafile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican_service_user.certfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican_service_user.collect_timing = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican_service_user.insecure = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican_service_user.keyfile = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican_service_user.split_loggers = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] barbican_service_user.timeout = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] vault.approle_role_id = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] vault.approle_secret_id = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] vault.kv_mountpoint = secret {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] vault.kv_path = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] vault.kv_version = 2 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] vault.namespace = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] vault.root_token_id = **** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] vault.ssl_ca_crt_file = None {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] vault.timeout = 60.0 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] vault.use_ssl = False {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:00 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] ******************************************************************************** {{(pid=92798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 25 18:04:00 devstack quobyte-client[93029]: Reading configuration file: /etc/quobyte/client.cfg Jun 25 18:04:00 devstack quobyte-client[93029]: Invalid parameters found, error: missing mount point. Jun 25 18:04:00 devstack quobyte-client[93029]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 25 18:04:00 devstack quobyte-client[93029]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 25 18:04:00 devstack cinder-volume[93026]: DEBUG oslo_concurrency.processutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] CMD "mount.quobyte" returned: 1 in 0.115s {{(pid=93026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:04:00 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:04:00 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:04:00 devstack cinder-volume[93026]: DEBUG cinder.volume.drivers.quobyte [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:04:00 devstack cinder-volume[93026]: INFO cinder.volume.drivers.quobyte [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 ... Jun 25 18:04:00 devstack cinder-volume[93026]: DEBUG oslo_concurrency.processutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 -c /etc/quobyte/client-cinder.cfg {{(pid=93026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:04:00 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 -c /etc/quobyte/client-cinder.cfg Jun 25 18:04:00 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:04:01 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Jun 25 18:04:01 devstack cinder-volume[93026]: DEBUG oslo_concurrency.processutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.799s {{(pid=93026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:04:01 devstack cinder-volume[93026]: INFO cinder.volume.drivers.quobyte [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 succeeded Jun 25 18:04:01 devstack cinder-volume[93026]: DEBUG cinder.volume.drivers.quobyte [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:04:01 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.815s {{(pid=93026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:04:01 devstack cinder-volume[93026]: DEBUG oslo_concurrency.processutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:04:01 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:04:01 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:04:02 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Jun 25 18:04:02 devstack cinder-volume[93026]: DEBUG oslo_concurrency.processutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.662s {{(pid=93026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:04:02 devstack cinder-volume[93026]: INFO cinder.volume.driver [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Driver hasn't implemented _init_vendor_properties() Jun 25 18:04:02 devstack cinder-volume[93026]: DEBUG cinder.volume.driver [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6810264587402, 'free_capacity_gb': 1775.6810264587402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93026) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 25 18:04:02 devstack cinder-volume[93026]: DEBUG oslo_db.sqlalchemy.engines [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93026) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:04:02 devstack cinder-volume[93026]: DEBUG dbcounter [-] [93026] Writer thread running {{(pid=93026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 18:04:02 devstack cinder-volume[93026]: DEBUG cinder.db.api [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Building query based on filter {{(pid=93026) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 25 18:04:02 devstack cinder-volume[93026]: DEBUG cinder.image.image_utils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93026) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 25 18:04:02 devstack cinder-volume[93026]: INFO cinder.keymgr.migration [None req-47d96659-a36b-42ce-aa85-341efa0fb0ee None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 25 18:04:02 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:04:02 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:04:02 devstack cinder-volume[93026]: DEBUG cinder.volume.drivers.quobyte [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:04:02 devstack cinder-volume[93026]: DEBUG cinder.volume.drivers.quobyte [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:04:02 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:04:02 devstack cinder-volume[93026]: DEBUG oslo_concurrency.processutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:04:02 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:04:02 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:04:03 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Jun 25 18:04:03 devstack cinder-volume[93026]: DEBUG oslo_concurrency.processutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.668s {{(pid=93026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:04:03 devstack cinder-volume[93026]: DEBUG cinder.manager [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Notifying Schedulers of capabilities ... {{(pid=93026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:04:03 devstack cinder-volume[93026]: INFO cinder.volume.manager [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Driver initialization completed successfully. Jun 25 18:04:03 devstack cinder-volume[93026]: INFO cinder.manager [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Initiating service 3 cleanup Jun 25 18:04:03 devstack cinder-volume[93026]: INFO cinder.manager [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Service 3 cleanup completed. Jun 25 18:04:03 devstack cinder-volume[93026]: DEBUG cinder.service [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Creating RPC server for service cinder-volume {{(pid=93026) start /opt/stack/cinder/cinder/service.py:231}} Jun 25 18:04:03 devstack cinder-volume[93026]: DEBUG cinder.service [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93026) start /opt/stack/cinder/cinder/service.py:237}} Jun 25 18:04:03 devstack cinder-volume[93026]: INFO cinder.volume.manager [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 25 18:04:03 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:04:03 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:04:03 devstack cinder-volume[93026]: DEBUG cinder.volume.drivers.quobyte [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:04:03 devstack cinder-volume[93026]: DEBUG cinder.volume.drivers.quobyte [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:04:03 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:04:03 devstack cinder-volume[93026]: DEBUG oslo_concurrency.processutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:04:03 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:04:03 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:04:04 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Jun 25 18:04:04 devstack cinder-volume[93026]: DEBUG oslo_concurrency.processutils [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.808s {{(pid=93026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:04:04 devstack cinder-volume[93026]: INFO cinder.volume.manager [None req-e7e2b23c-12b3-4b56-826a-f286c4985dd2 None None] Driver post RPC initialization completed successfully. Jun 25 18:04:07 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-60e5607e-c989-4531-b91f-e225dbe966ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:04:07 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-60e5607e-c989-4531-b91f-e225dbe966ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:04:07 devstack cinder-volume[93026]: DEBUG cinder.volume.drivers.quobyte [None req-60e5607e-c989-4531-b91f-e225dbe966ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:04:07 devstack cinder-volume[93026]: DEBUG cinder.volume.drivers.quobyte [None req-60e5607e-c989-4531-b91f-e225dbe966ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:04:07 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-60e5607e-c989-4531-b91f-e225dbe966ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:04:07 devstack cinder-volume[93026]: DEBUG oslo_concurrency.processutils [None req-60e5607e-c989-4531-b91f-e225dbe966ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:04:07 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:04:07 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:04:08 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Jun 25 18:04:08 devstack cinder-volume[93026]: DEBUG oslo_concurrency.processutils [None req-60e5607e-c989-4531-b91f-e225dbe966ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.630s {{(pid=93026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:04:08 devstack cinder-volume[93026]: DEBUG cinder.manager [None req-60e5607e-c989-4531-b91f-e225dbe966ac None None] Notifying Schedulers of capabilities ... {{(pid=93026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:04:10 devstack cinder-volume[92798]: DEBUG dbcounter [-] [92798] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92798) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:04:11 devstack cinder-volume[92798]: INFO oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Caught SIGTERM, stopping children Jun 25 18:04:11 devstack cinder-volume[92798]: DEBUG oslo_concurrency.lockutils [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Acquiring lock "singleton_lock" {{(pid=92798) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 18:04:11 devstack cinder-volume[92798]: DEBUG oslo_concurrency.lockutils [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Acquired lock "singleton_lock" {{(pid=92798) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 18:04:11 devstack cinder-volume[92798]: DEBUG oslo_concurrency.lockutils [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Releasing lock "singleton_lock" {{(pid=92798) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 18:04:11 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Stop services. {{(pid=92798) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 25 18:04:11 devstack cinder-volume[92798]: DEBUG oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Killing children. {{(pid=92798) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 25 18:04:11 devstack cinder-volume[92798]: INFO oslo_service.backend._eventlet.service [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Waiting on 1 children to exit Jun 25 18:04:13 devstack cinder-volume[93026]: DEBUG dbcounter [-] [93026] Writing DB stats cinder:SELECT=3 {{(pid=93026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:04:14 devstack cinder-volume[93026]: DEBUG dbcounter [-] [93026] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=93026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:04:16 devstack cinder-volume[93026]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 25 18:04:16 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Acquiring lock "singleton_lock" {{(pid=93026) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 18:04:16 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Acquired lock "singleton_lock" {{(pid=93026) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 18:04:16 devstack cinder-volume[93026]: DEBUG oslo_concurrency.lockutils [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Releasing lock "singleton_lock" {{(pid=93026) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 18:04:16 devstack cinder-volume[93026]: WARNING amqp [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 25 18:04:16 devstack cinder-volume[93026]: WARNING amqp [None req-c557468c-2aa7-4f0f-b8f4-8719107661bf None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 25 18:04:16 devstack cinder-volume[93353]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 25 18:04:16 devstack cinder-volume[93353]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 18:04:16 devstack cinder-volume[93353]: we strongly recommend against using it for new projects. Jun 25 18:04:16 devstack cinder-volume[93353]: If you are already using Eventlet, we recommend migrating to a different Jun 25 18:04:16 devstack cinder-volume[93353]: framework. For more detail see Jun 25 18:04:16 devstack cinder-volume[93353]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 18:04:16 devstack cinder-volume[93353]: import eventlet # noqa Jun 25 18:04:19 devstack cinder-volume[93353]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93353) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 18:04:19 devstack cinder-volume[93353]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93353) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 18:04:19 devstack cinder-volume[93353]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93353) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 18:04:20 devstack cinder-volume[93353]: INFO dbcounter [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] Registered counter for database cinder Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_db.sqlalchemy.engines [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93353) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG dbcounter [-] [93353] Writer thread running {{(pid=93353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 18:04:20 devstack cinder-volume[93353]: INFO cinder.rpc [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 25 18:04:20 devstack cinder-volume[93353]: INFO cinder.rpc [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_db.sqlalchemy.engines [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93353) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:04:20 devstack cinder-volume[93353]: INFO cinder.volume.manager [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] Determined volume DB was empty at startup. Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG cinder.volume.manager [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93353) __init__ /opt/stack/cinder/cinder/volume/manager.py:298}} Jun 25 18:04:20 devstack cinder-volume[93353]: WARNING stevedore.named [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 25 18:04:20 devstack cinder-volume[93353]: WARNING castellan.key_manager [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 18:04:20 devstack cinder-volume[93353]: WARNING cinder.keymgr.conf_key_mgr [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 18:04:20 devstack cinder-volume[93353]: INFO cinder.volume.manager [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_db.sqlalchemy.engines [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93353) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:04:20 devstack cinder-volume[93353]: INFO oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] Starting 1 workers Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] Started child 93651 {{(pid=93353) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] Full set of CONF: {{(pid=93353) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] ******************************************************************************** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] Configuration options gathered from: {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] ================================================================================ {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 25 18:04:20 devstack cinder-volume[93651]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] allow_availability_zone_fallback = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] allow_compression_on_image_upload = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] allowed_direct_url_schemes = [] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] api_rate_limit = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] auth_strategy = keystone {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_availability_zone = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_host = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_name = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_stats_polling_interval = 60 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backup_api_class = cinder.backup.api.API {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backup_name_template = backup-%s {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backup_use_same_host = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backup_use_temp_snapshot = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] chap_password = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] chap_username = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cinder_internal_tenant_project_id = f0f93730c02043e59059fe5f0443c548 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cinder_internal_tenant_user_id = 82bbd28565c14aaca476c7b20fbf5e49 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cluster = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] compression_format = gzip {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] compute_api_class = cinder.compute.nova.API {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] config_dir = [] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] config_source = [] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] control_exchange = openstack {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] debug = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] default_availability_zone = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] default_group_type = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] default_volume_type = QuobyteHD {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] disk_geometry = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] driver_client_cert = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] driver_client_cert_key = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] driver_data_namespace = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] driver_ssl_cert_path = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] driver_ssl_cert_verify = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] driver_use_ssl = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] enable_new_services = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] enable_unsupported_driver = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] enabled_backends = ['QuobyteHD'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] enforce_multipath_for_image_xfer = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] filter_function = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance_api_insecure = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance_api_servers = ['http://192.168.122.170/image'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance_api_ssl_compression = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance_ca_certificates_file = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance_catalog_info = image:glance:publicURL {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance_certfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance_keyfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance_num_retries = 3 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance_request_timeout = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] goodness_function = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] graceful_shutdown_timeout = 5 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] group_api_class = cinder.group.api.API {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] host = devstack {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] image_compress_on_upload = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] image_conversion_address_space_limit = 1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] image_conversion_cpu_limit = 60 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] image_conversion_disable = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93651) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] image_upload_use_cinder_backend = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] image_upload_use_internal_tenant = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] image_volume_cache_enabled = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] image_volume_cache_max_count = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] image_volume_cache_max_size_gb = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] init_host_max_objects_retrieval = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] instance_format = [instance: %(uuid)s] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] iscsi_target_flags = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] iscsi_write_cache = on {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] iser_helper = tgtadm {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] iser_ip_address = 192.168.122.170 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] iser_port = 3260 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] log_color = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] log_config_append = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] log_dir = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] log_file = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] log_options = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] log_rotate_interval = 1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] log_rotate_interval_type = days {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] log_rotation_type = none {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] max_age = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] max_logfile_count = 30 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] max_logfile_size_mb = 200 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] max_over_subscription_ratio = 20.0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] message_reap_interval = 86400 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] message_ttl = 2592000 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] migration_create_volume_timeout_secs = 300 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] monkey_patch = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] monkey_patch_modules = [] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] my_ip = 192.168.122.170 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] no_snapshot_gb_quota = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] num_iser_scan_tries = 3 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] num_shell_tries = 3 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] num_volume_device_scan_tries = 3 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] nvmeof_conn_info_version = 1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] nvmet_ns_id = 10 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] nvmet_port_id = 1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] osapi_max_limit = 1000 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] osapi_volume_ext_list = [] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] osapi_volume_listen_port = 8776 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] osapi_volume_use_ssl = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] osapi_volume_workers = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] per_volume_size_limit = -1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] periodic_fuzzy_delay = 60 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] periodic_interval = 60 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] public_endpoint = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] publish_errors = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] quota_backup_gigabytes = 1000 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] quota_backups = 10 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] quota_gigabytes = 1000 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] quota_groups = 10 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] quota_snapshots = 10 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] quota_volumes = 10 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] rate_limit_burst = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] rate_limit_except_level = CRITICAL {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] rate_limit_interval = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] reinit_driver_count = 3 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] replication_device = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] report_discard_supported = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] report_interval = 120 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] reservation_clean_interval = 86400 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] reservation_expire = 86400 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] reserved_image_namespaces = [] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] reserved_percentage = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] rpc_response_timeout = 120 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] run_external_periodic_tasks = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] scst_target_driver = iscsi {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] scst_target_iqn_name = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] service_down_time = 720 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] shell_completion = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] snapshot_name_template = snapshot-%s {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] split_loggers = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] state_path = /opt/stack/data/cinder {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] storage_availability_zone = nova {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] storage_protocol = iSCSI {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] syslog_log_facility = LOG_USER {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] target_helper = lioadm {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] target_ip_address = 192.168.122.170 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] target_port = 3260 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] target_protocol = iscsi {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] target_secondary_ip_addresses = [] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] trace_flags = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] transport_url = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] until_refresh = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] use_chap_auth = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] use_default_quota_class = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] use_journal = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] use_json = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] use_multipath_for_image_xfer = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] use_stderr = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] use_syslog = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] verify_glance_signatures = enabled {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] volume_api_class = cinder.volume.api.API {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] volume_backend_name = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] volume_clear = zero {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93651) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 25 18:04:20 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.quobyte [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 25 18:04:20 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.quobyte [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] volume_clear_ionice = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] volume_clear_size = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] volume_copy_bps_limit = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] volume_dd_blocksize = 1M {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] volume_name_template = volume-%s {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] volume_service_inithost_offload = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] volume_usage_audit_period = month {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Running cmd (subprocess): mount.quobyte {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] zoning_mode = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_concurrency.disable_process_locking = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.auth_section = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.auth_type = password {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.auth_version = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.cache = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.certfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.include_service_catalog = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.insecure = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.interface = public {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.keyfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_password = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcache_username = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.region_name = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.service_type = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.170/identity {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.backend = dogpile.cache.null {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.backend_argument = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.backend_expiration_time = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.config_prefix = cache.oslo {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.debug_cache_backend = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.enable_retry_client = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.enable_socket_keepalive = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.enabled = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.expiration_time = 600 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.hashclient_retry_attempts = 2 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.memcache_dead_retry = 300 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.memcache_pool_maxsize = 10 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.memcache_sasl_enabled = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.password = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.proxies = [] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.redis_db = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.redis_server = localhost:6379 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.retry_attempts = 2 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.retry_delay = 0.0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.socket_keepalive_count = 1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.socket_keepalive_idle = 1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.socket_keepalive_interval = 1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.socket_timeout = 1.0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.tls_allowed_ciphers = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.tls_cafile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.tls_certfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.tls_enabled = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.tls_keyfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cache.username = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] coordination.backend_url = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.asyncio_connection = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.asyncio_slave_connection = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.backend = sqlalchemy {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.connection = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.connection_debug = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.connection_parameters = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.connection_recycle_time = 3600 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.connection_trace = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.db_inc_retry_interval = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.db_max_retries = 20 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.db_max_retry_interval = 10 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.db_retry_interval = 1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.max_overflow = 50 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.max_pool_size = 5 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.max_retries = 10 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.mysql_wsrep_sync_wait = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.pool_timeout = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.retry_interval = 10 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.slave_connection = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.sqlite_synchronous = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.synchronous_reader = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] database.use_db_reconnect = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] profiler.connection_string = messaging:// {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] profiler.enabled = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] profiler.es_doc_type = notification {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] profiler.es_scroll_size = 10000 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] profiler.es_scroll_time = 2m {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] profiler.filter_error_trace = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] profiler.hmac_keys = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] profiler.sentinel_service_name = mymaster {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] profiler.socket_timeout = 0.1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] profiler.trace_requests = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] profiler.trace_sqlalchemy = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] profiler_jaeger.process_tags = {} {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] profiler_jaeger.service_name_prefix = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] profiler_otlp.service_name_prefix = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_policy.enforce_new_defaults = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: WARNING oslo_config.cfg [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_policy.enforce_scope = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_policy.policy_default_rule = default {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_policy.policy_file = policy.yaml {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] privsep_osbrick.group = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] privsep_osbrick.helper_command = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] privsep_osbrick.user = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cinder_sys_admin.group = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cinder_sys_admin.helper_command = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] cinder_sys_admin.user = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] service_user.auth_section = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] service_user.auth_type = password {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] service_user.cafile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] service_user.certfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] service_user.collect_timing = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] service_user.insecure = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:04:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] service_user.keyfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] service_user.send_service_user_token = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] service_user.split_loggers = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] service_user.timeout = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance.auth_section = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance.auth_type = password {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance.certfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:20 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance.collect_timing = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance.insecure = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance.keyfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance.region_name = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance.split_loggers = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] glance.timeout = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.backend_availability_zone = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.chap_password = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.chap_username = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.disk_geometry = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.driver_client_cert = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.driver_client_cert_key = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.driver_data_namespace = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.driver_use_ssl = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.extra_capabilities = {} {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.filter_function = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.goodness_function = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.iscsi_target_flags = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.iscsi_write_cache = on {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.iser_helper = tgtadm {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.iser_ip_address = 192.168.122.170 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.iser_port = 3260 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.nas_host = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.nas_login = admin {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.nas_mount_options = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.nas_password = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.nas_private_key = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.nas_share_path = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.num_shell_tries = 3 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.quobyte_volume_url = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.replication_device = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.report_discard_supported = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.reserved_percentage = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.target_helper = tgtadm {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.target_ip_address = 192.168.122.170 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.target_port = 3260 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.target_protocol = iscsi {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.trace_flags = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.unique_fqdn_network = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.use_chap_auth = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.volume_backend_name = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.volume_clear = zero {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.volume_clear_ionice = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.volume_clear_size = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_reports.file_event_handler = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_reports.log_dir = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.backend_availability_zone = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.backend_host = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.chap_password = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.chap_username = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.chiscsi_conf = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.disk_geometry = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.driver_client_cert = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.driver_data_namespace = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.driver_use_ssl = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.extra_capabilities = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.filter_function = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.goodness_function = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.iser_helper = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.iser_ip_address = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.iser_port = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.iser_target_prefix = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.nas_host = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.nas_login = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.nas_mount_options = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.nas_password = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.nas_private_key = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.nas_share_path = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.nas_ssh_port = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.num_shell_tries = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.nvmet_port_id = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.replication_device = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.report_discard_supported = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.reserved_percentage = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.scst_target_driver = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.storage_protocol = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.target_helper = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.target_ip_address = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.target_port = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.target_prefix = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.target_protocol = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.trace_flags = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.use_chap_auth = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.volume_clear = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.volume_clear_size = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] QuobyteHD.volumes_dir = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.ssl = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_notifications.driver = [] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_notifications.retry = -1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] key_manager.fixed_key = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.barbican_api_version = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.barbican_endpoint = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.barbican_endpoint_type = public {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.barbican_region_name = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.cafile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.certfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.collect_timing = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.insecure = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.keyfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.number_of_retries = 60 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.retry_delay = 1 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.send_service_user_token = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.split_loggers = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.timeout = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.verify_ssl = True {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican.verify_ssl_path = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican_service_user.auth_section = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican_service_user.auth_type = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican_service_user.cafile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican_service_user.certfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican_service_user.collect_timing = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican_service_user.insecure = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican_service_user.keyfile = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican_service_user.split_loggers = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] barbican_service_user.timeout = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] vault.approle_role_id = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] vault.approle_secret_id = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] vault.kv_mountpoint = secret {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] vault.kv_path = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] vault.kv_version = 2 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] vault.namespace = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] vault.root_token_id = **** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] vault.ssl_ca_crt_file = None {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] vault.timeout = 60.0 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] vault.use_ssl = False {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 18:04:21 devstack cinder-volume[93353]: DEBUG oslo_service.backend._eventlet.service [None req-e62722e2-17c7-4036-acc8-db7594dbf9e7 None None] ******************************************************************************** {{(pid=93353) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 25 18:04:21 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Jun 25 18:04:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.661s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:04:21 devstack cinder-volume[93651]: INFO cinder.volume.driver [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Driver hasn't implemented _init_vendor_properties() Jun 25 18:04:21 devstack cinder-volume[93651]: DEBUG cinder.volume.driver [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6810264587402, 'free_capacity_gb': 1775.6810264587402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93651) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 25 18:04:21 devstack cinder-volume[93651]: DEBUG oslo_db.sqlalchemy.engines [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93651) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 18:04:21 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writer thread running {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 18:04:21 devstack cinder-volume[93651]: DEBUG cinder.db.api [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Building query based on filter {{(pid=93651) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 25 18:04:21 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93651) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 25 18:04:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:04:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:04:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:04:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:04:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:04:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:04:21 devstack cinder-volume[93651]: INFO cinder.keymgr.migration [None req-cef9d64e-fc1e-4f5a-b7b7-ac6f2cc4e09b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 25 18:04:21 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:04:21 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:04:22 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Jun 25 18:04:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.618s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:04:22 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:04:22 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Driver initialization completed successfully. Jun 25 18:04:22 devstack cinder-volume[93651]: INFO cinder.manager [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Initiating service 3 cleanup Jun 25 18:04:22 devstack cinder-volume[93651]: INFO cinder.manager [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Service 3 cleanup completed. Jun 25 18:04:22 devstack cinder-volume[93651]: DEBUG cinder.service [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Creating RPC server for service cinder-volume {{(pid=93651) start /opt/stack/cinder/cinder/service.py:231}} Jun 25 18:04:22 devstack cinder-volume[93651]: DEBUG cinder.service [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93651) start /opt/stack/cinder/cinder/service.py:237}} Jun 25 18:04:22 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 25 18:04:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:04:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:04:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:04:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:04:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:04:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:04:22 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:04:22 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:04:23 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Jun 25 18:04:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.617s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:04:23 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4b6e4dd8-fae1-4abf-8f8d-dba899eb2132 None None] Driver post RPC initialization completed successfully. Jun 25 18:04:30 devstack cinder-volume[93353]: DEBUG dbcounter [-] [93353] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:04:32 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:04:33 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=2 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:04:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:04:39 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 6 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:04:39 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Flow 'volume_create_manager' (5c523b36-1d21-484d-85f8-9137c6a0ba17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76cedf23-c0a7-40b7-8cb6-2faa90b62cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76cedf23-c0a7-40b7-8cb6-2faa90b62cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1442807642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03cd1626-85ac-4a0a-b2cf-54298e7a4aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aed862946104a378200490c6c3f77c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:05:20Z,use_quota=True,user_id='488f600ea27d4edbb70965c7b61972a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b733b74c-f174-4c6c-bcbd-e423aaad8797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b733b74c-f174-4c6c-bcbd-e423aaad8797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7658114a-d3ca-45f3-82a9-41c1b350fbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7658114a-d3ca-45f3-82a9-41c1b350fbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03cd1626-85ac-4a0a-b2cf-54298e7a4aa7', 'volume_name': 'volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9e44b0-6fe5-4f89-8263-fc92b0fdd6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9e44b0-6fe5-4f89-8263-fc92b0fdd6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e4f4e8-ff8a-4750-8d61-264e3a153def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:05:20 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Volume 03cd1626-85ac-4a0a-b2cf-54298e7a4aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7', 'volume_size': 1} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1442807642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03cd1626-85ac-4a0a-b2cf-54298e7a4aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aed862946104a378200490c6c3f77c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:05:20Z,use_quota=True,user_id='488f600ea27d4edbb70965c7b61972a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Creating volume 03cd1626-85ac-4a0a-b2cf-54298e7a4aa7 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:05:20 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:05:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:05:20 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7 1073741824 Jun 25 18:05:20 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:05:21 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Jun 25 18:05:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7 1073741824" returned: 0 in 1.430s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:05:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:05:21 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7 Jun 25 18:05:21 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:05:22 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Jun 25 18:05:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7" returned: 0 in 0.773s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:05:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:05:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.299s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:05:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e4f4e8-ff8a-4750-8d61-264e3a153def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:05:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b12c11c-9e50-4997-9a40-b9286f5ef914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:05:22 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Volume volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7 (03cd1626-85ac-4a0a-b2cf-54298e7a4aa7): created successfully Jun 25 18:05:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b12c11c-9e50-4997-9a40-b9286f5ef914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:05:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Flow 'volume_create_manager' (5c523b36-1d21-484d-85f8-9137c6a0ba17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:05:22 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-222f3a60-da62-43e8-a376-9aaf03796d39 tempest-TaggedAttachmentsTest-1424418392 None] Created volume successfully. Jun 25 18:05:32 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:05:32 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:05:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:05:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:05:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:05:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:05:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:05:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:05:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:05:39 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:05:39 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:05:41 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Jun 25 18:05:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 2.334s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:05:41 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:05:41 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:05:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 6 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:05:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Flow 'volume_create_manager' (a361982c-d776-4ad3-8ef9-3d26c62838c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879de796-3cba-4f0b-a435-bb96f7f0ed0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879de796-3cba-4f0b-a435-bb96f7f0ed0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1606131997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4d318e-2e68-4ef3-8a81-86a3f8832487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8172ff425524301a9c2b7463da964d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:06:09Z,use_quota=True,user_id='878bb4c99bdb42839efac087bc357f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44bea8e1-3de7-439c-a27d-107a732fbe54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44bea8e1-3de7-439c-a27d-107a732fbe54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a5a5084-0027-4ec8-8759-90c716adcadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a5a5084-0027-4ec8-8759-90c716adcadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4d318e-2e68-4ef3-8a81-86a3f8832487', 'volume_name': 'volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc366cfc-1289-40d9-9b50-4822e603f8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc366cfc-1289-40d9-9b50-4822e603f8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a4bb68-9a1d-4a93-b84e-964ba5a8fda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:06:08 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Volume 4d4d318e-2e68-4ef3-8a81-86a3f8832487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487', 'volume_size': 1} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1606131997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4d318e-2e68-4ef3-8a81-86a3f8832487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8172ff425524301a9c2b7463da964d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:06:09Z,use_quota=True,user_id='878bb4c99bdb42839efac087bc357f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Creating volume 4d4d318e-2e68-4ef3-8a81-86a3f8832487 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:06:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:06:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:06:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:06:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:06:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:06:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:06:09 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:06:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:09 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487 1073741824 Jun 25 18:06:09 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:10 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487 1073741824" returned: 0 in 1.511s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:10 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487 Jun 25 18:06:10 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:11 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487" returned: 0 in 0.813s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] <== create_volume: return (2380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:06:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.386s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:06:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a4bb68-9a1d-4a93-b84e-964ba5a8fda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:06:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccd3e83-9a56-4532-a04f-e1fc2cb95a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:06:11 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Volume volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487 (4d4d318e-2e68-4ef3-8a81-86a3f8832487): created successfully Jun 25 18:06:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccd3e83-9a56-4532-a04f-e1fc2cb95a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:06:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Flow 'volume_create_manager' (a361982c-d776-4ad3-8ef9-3d26c62838c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:06:11 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ff1c49e0-94c3-46de-928f-02951d713b92 tempest-ServerActionsTestOtherA-60761802 None] Created volume successfully. Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Flow 'volume_create_manager' (f1d712f2-4a9d-4de6-9ddd-30a439656e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4007a938-6b76-4505-b4a9-ff5c782c0e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4007a938-6b76-4505-b4a9-ff5c782c0e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1450738676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632fa694-cffe-4a47-8681-604aeec2b13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1b0865de704e1baf10b42cf6ecc6d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:06:12Z,use_quota=True,user_id='ce8d4d9c379c43398550d9bf681b2625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4543f002-5087-47dc-851e-2dbdfc9927ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4543f002-5087-47dc-851e-2dbdfc9927ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87b4372-ede9-4b7b-8fc4-36bbe94846a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87b4372-ede9-4b7b-8fc4-36bbe94846a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '632fa694-cffe-4a47-8681-604aeec2b13b', 'volume_name': 'volume-632fa694-cffe-4a47-8681-604aeec2b13b', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1b3406-971c-40f8-868b-4ba6fe2de39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1b3406-971c-40f8-868b-4ba6fe2de39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986736e4-bac7-4b1a-bd6e-dd470b0389c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:06:12 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Volume 632fa694-cffe-4a47-8681-604aeec2b13b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-632fa694-cffe-4a47-8681-604aeec2b13b', 'volume_size': 1} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1450738676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632fa694-cffe-4a47-8681-604aeec2b13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1b0865de704e1baf10b42cf6ecc6d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:06:12Z,use_quota=True,user_id='ce8d4d9c379c43398550d9bf681b2625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Creating volume 632fa694-cffe-4a47-8681-604aeec2b13b {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:06:12 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:06:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-632fa694-cffe-4a47-8681-604aeec2b13b 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:12 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-632fa694-cffe-4a47-8681-604aeec2b13b 1073741824 Jun 25 18:06:12 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:13 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-632fa694-cffe-4a47-8681-604aeec2b13b 1073741824" returned: 0 in 1.011s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-632fa694-cffe-4a47-8681-604aeec2b13b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:13 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-632fa694-cffe-4a47-8681-604aeec2b13b Jun 25 18:06:13 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:14 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-632fa694-cffe-4a47-8681-604aeec2b13b" returned: 0 in 0.864s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:06:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:06:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986736e4-bac7-4b1a-bd6e-dd470b0389c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632fa694-cffe-4a47-8681-604aeec2b13b', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:06:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdb2450-a856-4130-b7d0-51d17ff781a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:06:14 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Volume volume-632fa694-cffe-4a47-8681-604aeec2b13b (632fa694-cffe-4a47-8681-604aeec2b13b): created successfully Jun 25 18:06:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdb2450-a856-4130-b7d0-51d17ff781a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:06:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Flow 'volume_create_manager' (f1d712f2-4a9d-4de6-9ddd-30a439656e52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:06:14 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-625b59c4-b682-4448-addb-19647b7af7fe tempest-AttachVolumeShelveTestJSON-293808254 None] Created volume successfully. Jun 25 18:06:24 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1,cinder:SELECT=4 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:06:33 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:06:37 devstack cinder-volume[93651]: WARNING py.warnings [req-fef2195d-1036-4164-b44a-d146cc68cadc req-d9757556-9ac8-44d3-8fbc-efbc8f2b888b tempest-AttachVolumeShelveTestJSON-293808254 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 25 18:06:37 devstack cinder-volume[93651]: .first() Jun 25 18:06:37 devstack cinder-volume[93651]: Jun 25 18:06:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-fef2195d-1036-4164-b44a-d146cc68cadc req-d9757556-9ac8-44d3-8fbc-efbc8f2b888b tempest-AttachVolumeShelveTestJSON-293808254 None] No connector for attachment 299b8468-a401-4cf9-9cf6-560e40beefcf; skipping storage backend terminate_connection call. {{(pid=93651) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5365}} Jun 25 18:06:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-fef2195d-1036-4164-b44a-d146cc68cadc req-d9757556-9ac8-44d3-8fbc-efbc8f2b888b tempest-AttachVolumeShelveTestJSON-293808254 None] Deleting attachment 299b8468-a401-4cf9-9cf6-560e40beefcf. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:06:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:06:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:06:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:06:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:06:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:06:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:06:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:39 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:06:39 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:40 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.662s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:06:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-3142c372-a2c0-4d91-a0e0-095b071d14cc req-3cb7174e-8f0d-438e-855b-31879b7fdacf tempest-TaggedAttachmentsTest-1424418392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:06:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-3142c372-a2c0-4d91-a0e0-095b071d14cc req-3cb7174e-8f0d-438e-855b-31879b7fdacf tempest-TaggedAttachmentsTest-1424418392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:06:41 devstack cinder-volume[93651]: INFO oslo.privsep.daemon [req-3142c372-a2c0-4d91-a0e0-095b071d14cc req-3cb7174e-8f0d-438e-855b-31879b7fdacf tempest-TaggedAttachmentsTest-1424418392 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9hqhi4o9/privsep.sock'] Jun 25 18:06:41 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9hqhi4o9/privsep.sock Jun 25 18:06:41 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 18:06:42 devstack cinder-volume[93651]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 25 18:06:43 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:43 devstack cinder-volume[93651]: INFO oslo.privsep.daemon [req-3142c372-a2c0-4d91-a0e0-095b071d14cc req-3cb7174e-8f0d-438e-855b-31879b7fdacf tempest-TaggedAttachmentsTest-1424418392 None] Spawned new privsep daemon via rootwrap Jun 25 18:06:43 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [req-3142c372-a2c0-4d91-a0e0-095b071d14cc req-3cb7174e-8f0d-438e-855b-31879b7fdacf tempest-TaggedAttachmentsTest-1424418392 None] Accepted privsep connection to /tmp/tmp9hqhi4o9/privsep.sock {{(pid=93651) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 25 18:06:43 devstack cinder-volume[93651]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 25 18:06:43 devstack cinder-volume[93651]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 25 18:06:43 devstack cinder-volume[93651]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 25 18:06:43 devstack cinder-volume[93651]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95330 Jun 25 18:06:43 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[786b6ec1-6949-4f29-9b65-3d9579bf2fbc]: (2,) {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:06:43 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[1141fa73-866c-46cf-ad02-3d2eca2541e4]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:06:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-3142c372-a2c0-4d91-a0e0-095b071d14cc req-3cb7174e-8f0d-438e-855b-31879b7fdacf tempest-TaggedAttachmentsTest-1424418392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:43 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7 Jun 25 18:06:43 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:43 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-3142c372-a2c0-4d91-a0e0-095b071d14cc req-3cb7174e-8f0d-438e-855b-31879b7fdacf tempest-TaggedAttachmentsTest-1424418392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7" returned: 0 in 0.748s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-3142c372-a2c0-4d91-a0e0-095b071d14cc req-3cb7174e-8f0d-438e-855b-31879b7fdacf tempest-TaggedAttachmentsTest-1424418392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.425s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:06:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-3142c372-a2c0-4d91-a0e0-095b071d14cc req-3cb7174e-8f0d-438e-855b-31879b7fdacf tempest-TaggedAttachmentsTest-1424418392 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe09040f-baf7-482b-9f0d-e82bc2a269f4', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:06:44 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-3142c372-a2c0-4d91-a0e0-095b071d14cc req-3cb7174e-8f0d-438e-855b-31879b7fdacf tempest-TaggedAttachmentsTest-1424418392 None] attachment_update completed successfully. Jun 25 18:06:51 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-ba2bff6c-04b8-4f2b-9607-a050a5e27963 req-03253177-ef1f-4c60-bce7-f5fdb4ecac7b tempest-TaggedAttachmentsTest-1424418392 None] Terminate volume connection completed successfully. Jun 25 18:06:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-ba2bff6c-04b8-4f2b-9607-a050a5e27963 req-03253177-ef1f-4c60-bce7-f5fdb4ecac7b tempest-TaggedAttachmentsTest-1424418392 None] Deleting attachment fe09040f-baf7-482b-9f0d-e82bc2a269f4. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:06:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-375f2741-a5fe-48f1-a275-fd4f3a00fa56 req-4fbaea31-4575-4c73-b47d-61b36d810082 tempest-ServerActionsTestOtherA-60761802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:06:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-375f2741-a5fe-48f1-a275-fd4f3a00fa56 req-4fbaea31-4575-4c73-b47d-61b36d810082 tempest-ServerActionsTestOtherA-60761802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:06:57 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5af1b7-dbdd-4b79-b558-578fce1853a7]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:06:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-375f2741-a5fe-48f1-a275-fd4f3a00fa56 req-4fbaea31-4575-4c73-b47d-61b36d810082 tempest-ServerActionsTestOtherA-60761802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:06:57 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487 Jun 25 18:06:57 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:06:58 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jun 25 18:06:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-375f2741-a5fe-48f1-a275-fd4f3a00fa56 req-4fbaea31-4575-4c73-b47d-61b36d810082 tempest-ServerActionsTestOtherA-60761802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487" returned: 0 in 0.933s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:06:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-375f2741-a5fe-48f1-a275-fd4f3a00fa56 req-4fbaea31-4575-4c73-b47d-61b36d810082 tempest-ServerActionsTestOtherA-60761802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.949s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:06:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-375f2741-a5fe-48f1-a275-fd4f3a00fa56 req-4fbaea31-4575-4c73-b47d-61b36d810082 tempest-ServerActionsTestOtherA-60761802 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3940075-e9de-4151-9c86-12aca6844295', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:06:58 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-375f2741-a5fe-48f1-a275-fd4f3a00fa56 req-4fbaea31-4575-4c73-b47d-61b36d810082 tempest-ServerActionsTestOtherA-60761802 None] attachment_update completed successfully. Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Flow 'volume_create_manager' (e9640726-3623-4539-b270-b02a348b6350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9e4c44-d306-4355-b058-b6ac54595b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9e4c44-d306-4355-b058-b6ac54595b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-455576683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee95287-dd32-4596-af2b-61706cda49dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc95258ab2f4a138f3d9b7c812449f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:07:06Z,use_quota=True,user_id='94cbf59b00af4c61bedb77a829c8b6d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f2d5ef-18b8-4c6b-b724-8c51a17536b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f2d5ef-18b8-4c6b-b724-8c51a17536b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1c80fe-2588-48fd-b726-3dad4ea680d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1c80fe-2588-48fd-b726-3dad4ea680d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee95287-dd32-4596-af2b-61706cda49dd', 'volume_name': 'volume-9ee95287-dd32-4596-af2b-61706cda49dd', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5dbd871-ee35-409e-812d-1a8bb6837eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5dbd871-ee35-409e-812d-1a8bb6837eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c777d2da-da4c-4f78-9419-eae9629dab4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:06 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Volume 9ee95287-dd32-4596-af2b-61706cda49dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee95287-dd32-4596-af2b-61706cda49dd', 'volume_size': 1} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-455576683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee95287-dd32-4596-af2b-61706cda49dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc95258ab2f4a138f3d9b7c812449f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:07:06Z,use_quota=True,user_id='94cbf59b00af4c61bedb77a829c8b6d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Creating volume 9ee95287-dd32-4596-af2b-61706cda49dd {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:07:06 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:07:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ee95287-dd32-4596-af2b-61706cda49dd 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:06 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ee95287-dd32-4596-af2b-61706cda49dd 1073741824 Jun 25 18:07:06 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:07 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ee95287-dd32-4596-af2b-61706cda49dd 1073741824" returned: 0 in 1.423s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ee95287-dd32-4596-af2b-61706cda49dd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:07 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ee95287-dd32-4596-af2b-61706cda49dd Jun 25 18:07:07 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:09 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ee95287-dd32-4596-af2b-61706cda49dd" returned: 0 in 1.439s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] <== create_volume: return (2978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:07:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.980s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c777d2da-da4c-4f78-9419-eae9629dab4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee95287-dd32-4596-af2b-61706cda49dd', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7e5819-c6f6-46f2-bb0d-17ccb35044a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:07:09 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Volume volume-9ee95287-dd32-4596-af2b-61706cda49dd (9ee95287-dd32-4596-af2b-61706cda49dd): created successfully Jun 25 18:07:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7e5819-c6f6-46f2-bb0d-17ccb35044a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:07:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Flow 'volume_create_manager' (e9640726-3623-4539-b270-b02a348b6350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:07:09 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-230149cc-a261-4c6d-8406-8dd74b2e60bf tempest-VolumesAdminNegativeTest-1734919872 None] Created volume successfully. Jun 25 18:07:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-fa2696c6-7bec-48d8-a109-06218a44e26d req-b92fecf7-403f-48c3-8769-286b148d0f04 tempest-ServerActionsTestOtherA-60761802 None] Terminate volume connection completed successfully. Jun 25 18:07:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-fa2696c6-7bec-48d8-a109-06218a44e26d req-b92fecf7-403f-48c3-8769-286b148d0f04 tempest-ServerActionsTestOtherA-60761802 None] Deleting attachment e3940075-e9de-4151-9c86-12aca6844295. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:07:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Acquiring lock "cinder-9ee95287-dd32-4596-af2b-61706cda49dd-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:07:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Lock "cinder-9ee95287-dd32-4596-af2b-61706cda49dd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:07:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Acquiring lock "cinder-quobyte-9ee95287-dd32-4596-af2b-61706cda49dd" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:07:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Lock "cinder-quobyte-9ee95287-dd32-4596-af2b-61706cda49dd" acquired by "delete_volume" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:07:11 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[0462b7c0-eef4-48fe-b831-89eb3c42f8a2]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:07:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ee95287-dd32-4596-af2b-61706cda49dd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:11 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ee95287-dd32-4596-af2b-61706cda49dd Jun 25 18:07:11 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:12 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ee95287-dd32-4596-af2b-61706cda49dd" returned: 0 in 0.960s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ee95287-dd32-4596-af2b-61706cda49dd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:12 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ee95287-dd32-4596-af2b-61706cda49dd Jun 25 18:07:12 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-fa2696c6-7bec-48d8-a109-06218a44e26d req-a455ea78-818c-4f02-be75-d2acb1808c66 tempest-ServerActionsTestOtherA-60761802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-fa2696c6-7bec-48d8-a109-06218a44e26d req-a455ea78-818c-4f02-be75-d2acb1808c66 tempest-ServerActionsTestOtherA-60761802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:12 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[5011d697-c1f1-4c2b-80ee-fcc8718848b2]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:07:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-fa2696c6-7bec-48d8-a109-06218a44e26d req-a455ea78-818c-4f02-be75-d2acb1808c66 tempest-ServerActionsTestOtherA-60761802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:13 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487 Jun 25 18:07:13 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:13 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ee95287-dd32-4596-af2b-61706cda49dd" returned: 0 in 1.173s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Lock "cinder-quobyte-9ee95287-dd32-4596-af2b-61706cda49dd" released by "delete_volume" :: held 2.198s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:07:13 devstack cinder-volume[93651]: WARNING cinder.quota [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:07:13 devstack cinder-volume[93651]: WARNING cinder.quota [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:07:13 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Created reservations ['ed415c2d-a3d6-4886-80e8-f8fbdc085b01', '3a7c4ce8-5ad3-4b53-a823-5594f7674e7e', 'c11751b8-5eee-433c-a1f7-b3262dd8ca3f', '0c0cf43e-cecf-4f46-a1fb-ff7a16a47947'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:07:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:07:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:07:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:14 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:07:14 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:14 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-fa2696c6-7bec-48d8-a109-06218a44e26d req-a455ea78-818c-4f02-be75-d2acb1808c66 tempest-ServerActionsTestOtherA-60761802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487" returned: 0 in 1.525s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-fa2696c6-7bec-48d8-a109-06218a44e26d req-a455ea78-818c-4f02-be75-d2acb1808c66 tempest-ServerActionsTestOtherA-60761802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.569s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-fa2696c6-7bec-48d8-a109-06218a44e26d req-a455ea78-818c-4f02-be75-d2acb1808c66 tempest-ServerActionsTestOtherA-60761802 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1685eb4d-cb11-48bc-bfc3-e059c59098d4', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:07:14 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-fa2696c6-7bec-48d8-a109-06218a44e26d req-a455ea78-818c-4f02-be75-d2acb1808c66 tempest-ServerActionsTestOtherA-60761802 None] attachment_update completed successfully. Jun 25 18:07:15 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.264s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:15 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:07:15 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Deleted volume successfully. Jun 25 18:07:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-21857a2e-e21a-4760-ab6f-b458ae3cab71 tempest-VolumesAdminNegativeTest-1734919872 None] Lock "cinder-9ee95287-dd32-4596-af2b-61706cda49dd-delete_volume" released by "delete_volume" :: held 4.006s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:07:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Acquiring lock "cinder-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:07:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Lock "cinder-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:07:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Acquiring lock "cinder-quobyte-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:07:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Lock "cinder-quobyte-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:07:18 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61ea304-3ba5-4290-a867-adcd9636a66a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:07:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:18 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7 Jun 25 18:07:18 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:18 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7" returned: 0 in 0.819s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:18 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7 Jun 25 18:07:18 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:19 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7" returned: 0 in 0.719s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Lock "cinder-quobyte-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7" released by "delete_volume" :: held 1.591s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:07:19 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Created reservations ['b1844153-954e-4516-a21f-bf86d000f54b', '559710b7-e18d-45e4-855a-1f8c15d562e1', '983e977f-68c2-4eaa-9199-b247b354e0d9', 'c787b980-791d-4e13-9954-c3372ab8650f'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:07:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:07:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:07:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:19 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:07:19 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:20 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.825s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:20 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:07:20 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Deleted volume successfully. Jun 25 18:07:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e571dc4f-0e65-4088-9567-08eddd315e30 tempest-TaggedAttachmentsTest-1424418392 None] Lock "cinder-03cd1626-85ac-4a0a-b2cf-54298e7a4aa7-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:07:29 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=28,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=2 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:07:30 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=35,cinder:UPDATE=26,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:07:39 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Acquiring lock "cinder-632fa694-cffe-4a47-8681-604aeec2b13b-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:07:39 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Lock "cinder-632fa694-cffe-4a47-8681-604aeec2b13b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:07:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:07:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:07:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:07:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:39 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Acquiring lock "cinder-quobyte-632fa694-cffe-4a47-8681-604aeec2b13b" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:07:39 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:07:39 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:39 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Lock "cinder-quobyte-632fa694-cffe-4a47-8681-604aeec2b13b" acquired by "delete_volume" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:07:39 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca5f10b-e718-4b83-b34c-fa6c3d9c21f6]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:07:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-632fa694-cffe-4a47-8681-604aeec2b13b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:39 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-632fa694-cffe-4a47-8681-604aeec2b13b Jun 25 18:07:39 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:40 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.870s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:07:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:07:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 8 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:07:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:07:40 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-632fa694-cffe-4a47-8681-604aeec2b13b" returned: 0 in 1.102s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-632fa694-cffe-4a47-8681-604aeec2b13b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:40 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-632fa694-cffe-4a47-8681-604aeec2b13b Jun 25 18:07:40 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:41 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-632fa694-cffe-4a47-8681-604aeec2b13b" returned: 0 in 0.810s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Lock "cinder-quobyte-632fa694-cffe-4a47-8681-604aeec2b13b" released by "delete_volume" :: held 1.984s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:07:41 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Created reservations ['08690cc1-6da4-4786-b465-023768a6bf0e', '216a910c-0512-491f-8b32-e6a1af9f61ac', 'b9c6e0c9-d96e-445c-99e2-29cff853680a', '86f11a5c-024a-4d14-82d9-e306440f9982'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:07:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:07:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:07:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:07:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:07:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:07:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:07:41 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:07:41 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:07:42 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jun 25 18:07:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.770s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:07:42 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:07:42 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Deleted volume successfully. Jun 25 18:07:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0d4c381c-5bdd-4cf2-b1ad-6ca638b1e8f3 tempest-AttachVolumeShelveTestJSON-293808254 None] Lock "cinder-632fa694-cffe-4a47-8681-604aeec2b13b-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:07:51 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=11,cinder:SELECT=5,cinder:INSERT=2 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:07:52 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:07:53 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-f285a66e-343b-4b17-9ba9-521c78dc5b92 req-12f0f5e3-1926-46cb-ae4e-38f8f36fdb5f tempest-ServerActionsTestOtherA-60761802 None] Terminate volume connection completed successfully. Jun 25 18:07:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-f285a66e-343b-4b17-9ba9-521c78dc5b92 req-12f0f5e3-1926-46cb-ae4e-38f8f36fdb5f tempest-ServerActionsTestOtherA-60761802 None] Deleting attachment 1685eb4d-cb11-48bc-bfc3-e059c59098d4. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:08:03 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=2 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:08:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Acquiring lock "cinder-4d4d318e-2e68-4ef3-8a81-86a3f8832487-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Lock "cinder-4d4d318e-2e68-4ef3-8a81-86a3f8832487-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Acquiring lock "cinder-quobyte-4d4d318e-2e68-4ef3-8a81-86a3f8832487" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Lock "cinder-quobyte-4d4d318e-2e68-4ef3-8a81-86a3f8832487" acquired by "delete_volume" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:13 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2888503-da3c-4161-8afa-4c687c362af4]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:08:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:13 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487 Jun 25 18:08:13 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:14 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487" returned: 0 in 0.996s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:14 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487 Jun 25 18:08:14 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:15 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d4d318e-2e68-4ef3-8a81-86a3f8832487" returned: 0 in 1.102s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Lock "cinder-quobyte-4d4d318e-2e68-4ef3-8a81-86a3f8832487" released by "delete_volume" :: held 2.166s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:15 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Created reservations ['ed236e05-d4e5-4f1b-bfcb-7a872b5cec5f', '18d234bd-a9cb-4648-a5d2-d43f19a513d2', 'f375c9b5-0ce0-41f4-866c-d3068ae9bcc7', '0c473380-13d9-4e51-9123-c9ee470e1946'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:08:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:15 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:15 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:15 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:08:15 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:16 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.820s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:16 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:08:16 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Deleted volume successfully. Jun 25 18:08:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1c605dec-c47f-4021-9acf-a5a3c477bb0b tempest-ServerActionsTestOtherA-60761802 None] Lock "cinder-4d4d318e-2e68-4ef3-8a81-86a3f8832487-delete_volume" released by "delete_volume" :: held 3.323s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:08:33 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=5,cinder:SELECT=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:08:33 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=12 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:08:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:08:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:39 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:08:39 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Flow 'volume_create_manager' (db2ee766-9138-4c23-a3ad-e4fe91b6be7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8db414-9f10-4157-a373-a5beb00aeb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8db414-9f10-4157-a373-a5beb00aeb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-961034906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1fa39c-46ac-4160-bb07-998b97355a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1fd6b280baf40fb830e6941624cea6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:40Z,use_quota=True,user_id='e4354279765d442684398547fa5fc241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf8e23a-a8d8-4486-a479-beafc0919f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf8e23a-a8d8-4486-a479-beafc0919f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f376080-4a47-436a-afa4-5fe7e22eb0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f376080-4a47-436a-afa4-5fe7e22eb0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a1fa39c-46ac-4160-bb07-998b97355a5a', 'volume_name': 'volume-2a1fa39c-46ac-4160-bb07-998b97355a5a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7302713f-a997-47f2-a99e-4afb7bdb7375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7302713f-a997-47f2-a99e-4afb7bdb7375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2970b6-2c9c-48e7-b2f4-0d54ac0386a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:40 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Volume 2a1fa39c-46ac-4160-bb07-998b97355a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a1fa39c-46ac-4160-bb07-998b97355a5a', 'volume_size': 1} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-961034906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1fa39c-46ac-4160-bb07-998b97355a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1fd6b280baf40fb830e6941624cea6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:40Z,use_quota=True,user_id='e4354279765d442684398547fa5fc241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Creating volume 2a1fa39c-46ac-4160-bb07-998b97355a5a {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:08:40 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:08:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:40 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a 1073741824 Jun 25 18:08:40 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:41 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 2.029s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:41 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:08:41 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:08:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 8 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:08:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:08:42 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a 1073741824" returned: 0 in 2.365s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:43 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a Jun 25 18:08:43 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:45 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a" returned: 0 in 2.133s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] <== create_volume: return (4720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:08:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.725s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2970b6-2c9c-48e7-b2f4-0d54ac0386a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a1fa39c-46ac-4160-bb07-998b97355a5a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd5e501-1784-426a-92a6-ab6b054ad575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:45 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Volume volume-2a1fa39c-46ac-4160-bb07-998b97355a5a (2a1fa39c-46ac-4160-bb07-998b97355a5a): created successfully Jun 25 18:08:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd5e501-1784-426a-92a6-ab6b054ad575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Flow 'volume_create_manager' (db2ee766-9138-4c23-a3ad-e4fe91b6be7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:45 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-10ca59b6-2c69-4ba3-9fe5-1446c2af82d4 tempest-DeleteServersTestJSON-2071238646 None] Created volume successfully. Jun 25 18:08:48 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:08:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Flow 'volume_create_manager' (10ceca82-4a13-43c0-8745-ad0c043d6e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d84118c-c7db-460a-b4c3-64a4c737f766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d84118c-c7db-460a-b4c3-64a4c737f766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-140929284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0393a70e-233d-43be-8f1b-a485f1372ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db67199ee8c14e1dab8e69a1c681aeb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:49Z,use_quota=True,user_id='286b93562ff642a3a9defab12be598c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c76e09a-7af1-45be-89b2-aac400d04d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c76e09a-7af1-45be-89b2-aac400d04d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0abedef-ea22-4c67-b27c-20bcbad96c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0abedef-ea22-4c67-b27c-20bcbad96c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0393a70e-233d-43be-8f1b-a485f1372ce9', 'volume_name': 'volume-0393a70e-233d-43be-8f1b-a485f1372ce9', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e38edea-bdba-4bac-b3cb-bcd2121e488c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e38edea-bdba-4bac-b3cb-bcd2121e488c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e21827-778b-4e5d-8d49-63f92247cc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:49 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Volume 0393a70e-233d-43be-8f1b-a485f1372ce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0393a70e-233d-43be-8f1b-a485f1372ce9', 'volume_size': 1} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-140929284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0393a70e-233d-43be-8f1b-a485f1372ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db67199ee8c14e1dab8e69a1c681aeb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:49Z,use_quota=True,user_id='286b93562ff642a3a9defab12be598c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Creating volume 0393a70e-233d-43be-8f1b-a485f1372ce9 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:08:49 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0393a70e-233d-43be-8f1b-a485f1372ce9 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:49 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0393a70e-233d-43be-8f1b-a485f1372ce9 1073741824 Jun 25 18:08:49 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-ec9637c9-5bfe-48e6-99d0-485475a6ffaf req-6a195bd5-e868-4a27-bb4f-e0ae01d00b72 tempest-DeleteServersTestJSON-2071238646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:50 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:08:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Flow 'volume_create_manager' (ca0ce5e9-7953-40b0-b1f6-cdd422978313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d548715-d7f3-41f3-aceb-ca0a59b22ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d548715-d7f3-41f3-aceb-ca0a59b22ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1398948940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=436b09b4-a324-4726-9560-d1ad6b134a2e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='80a05dc0e8014f89b3abb47766789e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:51Z,use_quota=True,user_id='c7ab0284364b494a852c48382bb11522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194e5cb8-0e07-47af-b026-31bda08e082f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194e5cb8-0e07-47af-b026-31bda08e082f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2f8967-9071-4b8c-88fe-1e5695c72020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2f8967-9071-4b8c-88fe-1e5695c72020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '436b09b4-a324-4726-9560-d1ad6b134a2e', 'volume_name': 'volume-436b09b4-a324-4726-9560-d1ad6b134a2e', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1551f0-09b1-43da-9bcf-277323164961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1551f0-09b1-43da-9bcf-277323164961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafdd127-26e2-4d17-afbb-6db81d4201e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:51 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Volume 436b09b4-a324-4726-9560-d1ad6b134a2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-436b09b4-a324-4726-9560-d1ad6b134a2e', 'volume_size': 1} Jun 25 18:08:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:51 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0393a70e-233d-43be-8f1b-a485f1372ce9 1073741824" returned: 0 in 2.106s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0393a70e-233d-43be-8f1b-a485f1372ce9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:51 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0393a70e-233d-43be-8f1b-a485f1372ce9 Jun 25 18:08:51 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:52 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0393a70e-233d-43be-8f1b-a485f1372ce9" returned: 0 in 0.942s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] <== create_volume: return (3126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:08:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.129s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-ec9637c9-5bfe-48e6-99d0-485475a6ffaf req-6a195bd5-e868-4a27-bb4f-e0ae01d00b72 tempest-DeleteServersTestJSON-2071238646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.481s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e21827-778b-4e5d-8d49-63f92247cc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0393a70e-233d-43be-8f1b-a485f1372ce9', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290cbc64-c3c9-4f3b-ba4c-2d20eb2bcfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:52 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e555cf-992b-4580-a7f9-0752df74774e]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:08:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-ec9637c9-5bfe-48e6-99d0-485475a6ffaf req-6a195bd5-e868-4a27-bb4f-e0ae01d00b72 tempest-DeleteServersTestJSON-2071238646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:52 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Volume volume-0393a70e-233d-43be-8f1b-a485f1372ce9 (0393a70e-233d-43be-8f1b-a485f1372ce9): created successfully Jun 25 18:08:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290cbc64-c3c9-4f3b-ba4c-2d20eb2bcfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Flow 'volume_create_manager' (10ceca82-4a13-43c0-8745-ad0c043d6e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:52 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-a69700ec-33f4-4460-9553-81df5bebc07d tempest-ServerRescueNegativeTestJSON-2008002869 None] Created volume successfully. Jun 25 18:08:52 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a Jun 25 18:08:52 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:53 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-ec9637c9-5bfe-48e6-99d0-485475a6ffaf req-6a195bd5-e868-4a27-bb4f-e0ae01d00b72 tempest-DeleteServersTestJSON-2071238646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a" returned: 0 in 0.809s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-ec9637c9-5bfe-48e6-99d0-485475a6ffaf req-6a195bd5-e868-4a27-bb4f-e0ae01d00b72 tempest-DeleteServersTestJSON-2071238646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.844s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1398948940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=436b09b4-a324-4726-9560-d1ad6b134a2e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='80a05dc0e8014f89b3abb47766789e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:08:51Z,use_quota=True,user_id='c7ab0284364b494a852c48382bb11522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:08:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Creating volume 436b09b4-a324-4726-9560-d1ad6b134a2e {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:08:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:08:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:08:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:08:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:08:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:08:53 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:08:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-436b09b4-a324-4726-9560-d1ad6b134a2e 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:53 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-436b09b4-a324-4726-9560-d1ad6b134a2e 1073741824 Jun 25 18:08:53 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-ec9637c9-5bfe-48e6-99d0-485475a6ffaf req-6a195bd5-e868-4a27-bb4f-e0ae01d00b72 tempest-DeleteServersTestJSON-2071238646 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-2a1fa39c-46ac-4160-bb07-998b97355a5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c1df3c3-3faa-4156-9ebc-b4383fbf838b', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:08:53 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-ec9637c9-5bfe-48e6-99d0-485475a6ffaf req-6a195bd5-e868-4a27-bb4f-e0ae01d00b72 tempest-DeleteServersTestJSON-2071238646 None] attachment_update completed successfully. Jun 25 18:08:54 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-436b09b4-a324-4726-9560-d1ad6b134a2e 1073741824" returned: 0 in 1.407s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-436b09b4-a324-4726-9560-d1ad6b134a2e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:54 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-436b09b4-a324-4726-9560-d1ad6b134a2e Jun 25 18:08:54 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:55 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-436b09b4-a324-4726-9560-d1ad6b134a2e" returned: 0 in 1.194s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] <== create_volume: return (2671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:08:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.677s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:08:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafdd127-26e2-4d17-afbb-6db81d4201e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-436b09b4-a324-4726-9560-d1ad6b134a2e', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c223f105-3dcc-49b9-8f1f-e4bcdee95c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:08:55 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Volume volume-436b09b4-a324-4726-9560-d1ad6b134a2e (436b09b4-a324-4726-9560-d1ad6b134a2e): created successfully Jun 25 18:08:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c223f105-3dcc-49b9-8f1f-e4bcdee95c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:08:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Flow 'volume_create_manager' (ca0ce5e9-7953-40b0-b1f6-cdd422978313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:08:55 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-84482f06-4c94-4298-995a-75345b0fa93e req-541eede5-af21-4ddb-8ffa-5545271376a3 tempest-VolumesGetTestJSON-10795261 None] Created volume successfully. Jun 25 18:08:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Acquiring lock "cinder-436b09b4-a324-4726-9560-d1ad6b134a2e-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Lock "cinder-436b09b4-a324-4726-9560-d1ad6b134a2e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Acquiring lock "cinder-quobyte-436b09b4-a324-4726-9560-d1ad6b134a2e" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:08:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Lock "cinder-quobyte-436b09b4-a324-4726-9560-d1ad6b134a2e" acquired by "delete_volume" :: waited 0.058s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:08:57 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a92b57e-10fc-470c-bdc5-f08a82d10c67]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:08:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-436b09b4-a324-4726-9560-d1ad6b134a2e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:57 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-436b09b4-a324-4726-9560-d1ad6b134a2e Jun 25 18:08:57 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:08:58 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jun 25 18:08:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-436b09b4-a324-4726-9560-d1ad6b134a2e" returned: 0 in 1.717s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:08:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-436b09b4-a324-4726-9560-d1ad6b134a2e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:08:58 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-436b09b4-a324-4726-9560-d1ad6b134a2e Jun 25 18:08:58 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:00 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-436b09b4-a324-4726-9560-d1ad6b134a2e" returned: 0 in 1.532s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Lock "cinder-quobyte-436b09b4-a324-4726-9560-d1ad6b134a2e" released by "delete_volume" :: held 3.329s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:00 devstack cinder-volume[93651]: DEBUG cinder.quota [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Created reservations ['04ac0bfe-a62d-464b-b8bc-186c8282372d', '76b80172-ef98-4d88-b727-d878bcaa2d9a', 'bb2db4a8-08c3-4762-85d2-651cac7ea808', '42d534f1-58f8-414a-a8f4-da712f6afe39'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:09:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:00 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:09:00 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:02 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.677s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:02 devstack cinder-volume[93651]: DEBUG cinder.manager [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:09:02 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Deleted volume successfully. Jun 25 18:09:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-33bddfd4-a7a5-49f0-a27c-c0ebe5528d67 req-c5d3f764-3d65-402a-94c7-5f79e2526eb5 tempest-VolumesGetTestJSON-10795261 None] Lock "cinder-436b09b4-a324-4726-9560-d1ad6b134a2e-delete_volume" released by "delete_volume" :: held 5.403s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:05 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-dfdb7e1e-5d25-460c-a695-7d720b48fa88 req-e7978123-be4c-4c80-9a49-bf6ab4a7979b tempest-DeleteServersTestJSON-2071238646 None] Terminate volume connection completed successfully. Jun 25 18:09:05 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-dfdb7e1e-5d25-460c-a695-7d720b48fa88 req-e7978123-be4c-4c80-9a49-bf6ab4a7979b tempest-DeleteServersTestJSON-2071238646 None] Deleting attachment 7c1df3c3-3faa-4156-9ebc-b4383fbf838b. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:09:07 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7bbd9a92-42a7-4e7a-b707-dd1688fe99e7 tempest-GroupSnapshotsTest-215261498 None] Group tempest-GroupSnapshotsTest-Group-1068502774: creating Jun 25 18:09:07 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7bbd9a92-42a7-4e7a-b707-dd1688fe99e7 tempest-GroupSnapshotsTest-215261498 None] Group tempest-GroupSnapshotsTest-Group-1068502774: created successfully Jun 25 18:09:07 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7bbd9a92-42a7-4e7a-b707-dd1688fe99e7 tempest-GroupSnapshotsTest-215261498 None] Create group completed successfully. Jun 25 18:09:08 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Acquiring lock "cinder-2a1fa39c-46ac-4160-bb07-998b97355a5a-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:08 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Lock "cinder-2a1fa39c-46ac-4160-bb07-998b97355a5a-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Acquiring lock "cinder-quobyte-2a1fa39c-46ac-4160-bb07-998b97355a5a" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Lock "cinder-quobyte-2a1fa39c-46ac-4160-bb07-998b97355a5a" acquired by "delete_volume" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[879cbdb4-d4fa-4c2f-b13a-4743216ef44f]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:09 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a Jun 25 18:09:09 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Flow 'volume_create_manager' (ca30e2f8-bfd8-4f11-8424-d6f0de9edf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5932b8ea-8df5-4bba-9f52-68c540a0f7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5932b8ea-8df5-4bba-9f52-68c540a0f7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-425614856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0b92778-4b45-43ee-9689-697d6c1788c0,host='devstack@QuobyteHD#QuobyteHD',id=6b418934-b161-4f98-a857-ce9068fd5084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a272b053d6b2442dae9ec948cea91aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:10Z,use_quota=True,user_id='2ba76bbf9048459a89ce70fd8a59ce8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f3f9c29-e9e3-47ef-8de1-8f356bc4a5ee),volume_type_id=7f3f9c29-e9e3-47ef-8de1-8f356bc4a5ee)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68bcc3ef-12b7-407d-9f3d-ed51f35d7a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68bcc3ef-12b7-407d-9f3d-ed51f35d7a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a804b946-ab92-4159-8a7b-69b884e2e7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a804b946-ab92-4159-8a7b-69b884e2e7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b418934-b161-4f98-a857-ce9068fd5084', 'volume_name': 'volume-6b418934-b161-4f98-a857-ce9068fd5084', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa19d114-8d78-445b-bfbe-b76528b35758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa19d114-8d78-445b-bfbe-b76528b35758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d15bf9-904f-4a46-a4e0-d9e4f2453830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:09 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Volume 6b418934-b161-4f98-a857-ce9068fd5084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b418934-b161-4f98-a857-ce9068fd5084', 'volume_size': 1} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c0b92778-4b45-43ee-9689-697d6c1788c0,created_at=2026-06-25T16:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-425614856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0b92778-4b45-43ee-9689-697d6c1788c0,host='devstack@QuobyteHD#QuobyteHD',id=6b418934-b161-4f98-a857-ce9068fd5084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a272b053d6b2442dae9ec948cea91aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:10Z,use_quota=True,user_id='2ba76bbf9048459a89ce70fd8a59ce8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f3f9c29-e9e3-47ef-8de1-8f356bc4a5ee),volume_type_id=7f3f9c29-e9e3-47ef-8de1-8f356bc4a5ee)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Creating volume 6b418934-b161-4f98-a857-ce9068fd5084 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:09:09 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:09:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:09 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 1073741824 Jun 25 18:09:09 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:10 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a" returned: 0 in 1.194s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:10 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a Jun 25 18:09:10 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:11 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 1073741824" returned: 0 in 1.731s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:11 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 Jun 25 18:09:11 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:11 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a1fa39c-46ac-4160-bb07-998b97355a5a" returned: 0 in 1.513s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Lock "cinder-quobyte-2a1fa39c-46ac-4160-bb07-998b97355a5a" released by "delete_volume" :: held 2.814s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:12 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Created reservations ['559117b2-8ccb-48a2-87a8-17bd409769b3', '5f1333cf-120e-4c00-b344-ffb9b30c8e1c', '3ec524d9-3d3c-4194-b549-808737d8aa1a', '717e36b4-54e2-4144-8409-879735b48375'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:09:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:12 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:09:12 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:13 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084" returned: 0 in 1.874s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] <== create_volume: return (3708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:09:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.712s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d15bf9-904f-4a46-a4e0-d9e4f2453830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b418934-b161-4f98-a857-ce9068fd5084', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cdd76f-259e-467d-8e2f-3ff6b9807238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:13 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Volume volume-6b418934-b161-4f98-a857-ce9068fd5084 (6b418934-b161-4f98-a857-ce9068fd5084): created successfully Jun 25 18:09:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cdd76f-259e-467d-8e2f-3ff6b9807238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Flow 'volume_create_manager' (ca30e2f8-bfd8-4f11-8424-d6f0de9edf44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:13 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-5b435578-ff00-43ca-bf73-cbf3e47bb90b tempest-GroupSnapshotsTest-215261498 None] Created volume successfully. Jun 25 18:09:13 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.722s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:09:14 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Deleted volume successfully. Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2b882e99-64c2-4f68-882d-dfab9fa57b27 tempest-DeleteServersTestJSON-2071238646 None] Lock "cinder-2a1fa39c-46ac-4160-bb07-998b97355a5a-delete_volume" released by "delete_volume" :: held 5.111s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Flow 'volume_create_manager' (2ce4f0b2-fa47-4b92-9ba3-e2da6bc1e02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df34322-e875-4a6a-9623-03ed20b8cbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df34322-e875-4a6a-9623-03ed20b8cbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-498462498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02efbdde-8b4e-43fb-b6f2-9b11824161ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e4d327116441b7a53975dd0fbc05d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:14Z,use_quota=True,user_id='5bd08726b0ec43aa9cee47131561485c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f084e102-7172-487c-9c05-40d7523a8504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f084e102-7172-487c-9c05-40d7523a8504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09b5170-972c-4df1-9731-b1df09c84ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09b5170-972c-4df1-9731-b1df09c84ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02efbdde-8b4e-43fb-b6f2-9b11824161ec', 'volume_name': 'volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f7a901-ba17-460c-a7c8-6051bae28459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f7a901-ba17-460c-a7c8-6051bae28459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565bcd4a-4229-4286-8f5f-fcb28c681f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:14 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Volume 02efbdde-8b4e-43fb-b6f2-9b11824161ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec', 'volume_size': 1} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-498462498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02efbdde-8b4e-43fb-b6f2-9b11824161ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e4d327116441b7a53975dd0fbc05d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:14Z,use_quota=True,user_id='5bd08726b0ec43aa9cee47131561485c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Creating volume 02efbdde-8b4e-43fb-b6f2-9b11824161ec {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:09:14 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:09:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:14 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec 1073741824 Jun 25 18:09:14 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:15 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] GroupSnapshot 56f727e7-005a-43f9-b0d7-cd0af47195b2: creating. Jun 25 18:09:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] Group snapshot 56f727e7-005a-43f9-b0d7-cd0af47195b2: creating. {{(pid=93651) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4478}} Jun 25 18:09:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:16 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec 1073741824" returned: 0 in 1.456s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:16 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec Jun 25 18:09:16 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Acquiring lock "cinder-0393a70e-233d-43be-8f1b-a485f1372ce9-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Lock "cinder-0393a70e-233d-43be-8f1b-a485f1372ce9-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Acquiring lock "cinder-quobyte-0393a70e-233d-43be-8f1b-a485f1372ce9" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Lock "cinder-quobyte-0393a70e-233d-43be-8f1b-a485f1372ce9" acquired by "delete_volume" :: waited 0.034s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:16 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[54712973-b6c7-4981-a915-dce21c44bd0b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0393a70e-233d-43be-8f1b-a485f1372ce9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:16 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0393a70e-233d-43be-8f1b-a485f1372ce9 Jun 25 18:09:16 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:17 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec" returned: 0 in 1.498s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] <== create_volume: return (3029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:09:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.032s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.829s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565bcd4a-4229-4286-8f5f-fcb28c681f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa8b5fc-a5c3-4556-998a-a3152543b39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:17 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Volume volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec (02efbdde-8b4e-43fb-b6f2-9b11824161ec): created successfully Jun 25 18:09:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa8b5fc-a5c3-4556-998a-a3152543b39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Flow 'volume_create_manager' (2ce4f0b2-fa47-4b92-9ba3-e2da6bc1e02a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] Creating offline snapshot 0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e of volume 6b418934-b161-4f98-a857-ce9068fd5084 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:09:17 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f495049d-8383-4bd8-92a4-d6efac2a9df2 tempest-AttachVolumeNegativeTest-510956435 None] Created volume successfully. Jun 25 18:09:17 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0393a70e-233d-43be-8f1b-a485f1372ce9" returned: 0 in 1.306s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0393a70e-233d-43be-8f1b-a485f1372ce9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:17 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb05ba37-f68f-44b9-9409-a1143f966af1]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:18 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0393a70e-233d-43be-8f1b-a485f1372ce9 Jun 25 18:09:18 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:18 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 Jun 25 18:09:18 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:19 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0393a70e-233d-43be-8f1b-a485f1372ce9" returned: 0 in 1.319s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Lock "cinder-quobyte-0393a70e-233d-43be-8f1b-a485f1372ce9" released by "delete_volume" :: held 2.705s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:19 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:19 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Created reservations ['17a255ed-d5ae-42f6-900c-d26d3cb133b4', 'd897f852-a5dd-47c6-adab-2dcde32c0fa2', '285c8725-1dcc-4a37-bd68-a54b4b330cf6', 'f8f22562-1851-4659-bebf-e99b2a4612f9'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:09:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084" returned: 0 in 1.483s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:19 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e 1G Jun 25 18:09:19 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:19 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:09:19 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:20 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.959s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:20 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:09:20 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Deleted volume successfully. Jun 25 18:09:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-78142ea3-5a96-4209-930b-fdecaf7bb1d7 tempest-ServerRescueNegativeTestJSON-2008002869 None] Lock "cinder-0393a70e-233d-43be-8f1b-a485f1372ce9-delete_volume" released by "delete_volume" :: held 4.173s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:21 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e 1G" returned: 0 in 2.185s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b418934-b161-4f98-a857-ce9068fd5084 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:21 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b418934-b161-4f98-a857-ce9068fd5084 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e Jun 25 18:09:21 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-4ee8393e-cfe1-40bf-8891-024c35a33dce req-6e8dc0af-ac39-4f8b-89e2-4a99fa67e7ef tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:23 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b418934-b161-4f98-a857-ce9068fd5084 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e" returned: 0 in 1.849s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:23 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:09:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:23 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e Jun 25 18:09:23 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:24 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e" returned: 0 in 0.953s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:24 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.info Jun 25 18:09:24 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:25 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.info" returned: 0 in 0.825s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:25 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:09:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:25 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.info Jun 25 18:09:25 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:25 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:09:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Flow 'volume_create_manager' (a0381b3b-fcf1-4dda-b588-7a8f0f7aec63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973e9610-5052-446b-8fcb-ac1ac453094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (973e9610-5052-446b-8fcb-ac1ac453094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-956683374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af8e2dd-702d-4066-b207-5410064c7cba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='494ff78fdef54397a6f08af394bdf51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:26Z,use_quota=True,user_id='5f89c54bfa38457c9543cffa7c62a0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14358b7-1492-4191-b76f-67677d912d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14358b7-1492-4191-b76f-67677d912d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29a23d7-c55e-4601-af83-994b8bb7c966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29a23d7-c55e-4601-af83-994b8bb7c966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5af8e2dd-702d-4066-b207-5410064c7cba', 'volume_name': 'volume-5af8e2dd-702d-4066-b207-5410064c7cba', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1b7549-0ec5-4e93-87e0-6796bb04097c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1b7549-0ec5-4e93-87e0-6796bb04097c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e24eec6-77ee-4d0a-b251-a166a959bdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:25 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Volume 5af8e2dd-702d-4066-b207-5410064c7cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5af8e2dd-702d-4066-b207-5410064c7cba', 'volume_size': 1} Jun 25 18:09:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:26 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.info" returned: 0 in 0.824s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.406s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-4ee8393e-cfe1-40bf-8891-024c35a33dce req-6e8dc0af-ac39-4f8b-89e2-4a99fa67e7ef tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.372s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:26 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[60506343-db98-4b5e-b545-f96a9aa31c01]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-4ee8393e-cfe1-40bf-8891-024c35a33dce req-6e8dc0af-ac39-4f8b-89e2-4a99fa67e7ef tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:26 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4ff1ecc3-ce80-4eec-8e50-1643bccc2a5b tempest-GroupSnapshotsTest-215261498 None] group_snapshot 56f727e7-005a-43f9-b0d7-cd0af47195b2: created successfully Jun 25 18:09:26 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec Jun 25 18:09:26 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:27 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-4ee8393e-cfe1-40bf-8891-024c35a33dce req-6e8dc0af-ac39-4f8b-89e2-4a99fa67e7ef tempest-AttachVolumeNegativeTest-510956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec" returned: 0 in 1.089s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-4ee8393e-cfe1-40bf-8891-024c35a33dce req-6e8dc0af-ac39-4f8b-89e2-4a99fa67e7ef tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.141s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.389s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-956683374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af8e2dd-702d-4066-b207-5410064c7cba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='494ff78fdef54397a6f08af394bdf51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:26Z,use_quota=True,user_id='5f89c54bfa38457c9543cffa7c62a0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:09:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Creating volume 5af8e2dd-702d-4066-b207-5410064c7cba {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:09:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:09:27 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:09:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5af8e2dd-702d-4066-b207-5410064c7cba 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:27 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5af8e2dd-702d-4066-b207-5410064c7cba 1073741824 Jun 25 18:09:27 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-4ee8393e-cfe1-40bf-8891-024c35a33dce req-6e8dc0af-ac39-4f8b-89e2-4a99fa67e7ef tempest-AttachVolumeNegativeTest-510956435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3be84c7-d9e8-414c-b319-71a837d9e60d', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:09:27 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-4ee8393e-cfe1-40bf-8891-024c35a33dce req-6e8dc0af-ac39-4f8b-89e2-4a99fa67e7ef tempest-AttachVolumeNegativeTest-510956435 None] attachment_update completed successfully. Jun 25 18:09:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:28 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5af8e2dd-702d-4066-b207-5410064c7cba 1073741824" returned: 0 in 1.231s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5af8e2dd-702d-4066-b207-5410064c7cba {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:28 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5af8e2dd-702d-4066-b207-5410064c7cba Jun 25 18:09:28 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:29 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5af8e2dd-702d-4066-b207-5410064c7cba" returned: 0 in 0.727s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.928s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e-9b17515c-e43b-434a-92f9-61f65332e0ed" by "_create_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e24eec6-77ee-4d0a-b251-a166a959bdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5af8e2dd-702d-4066-b207-5410064c7cba', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c021aacf-77c2-4c6b-8e7d-0cca2169d48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e-9b17515c-e43b-434a-92f9-61f65332e0ed" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Creating volume 9b17515c-e43b-434a-92f9-61f65332e0ed from snapshot 0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e {{(pid=93651) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-9b17515c-e43b-434a-92f9-61f65332e0ed" by "_copy_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:29 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Volume volume-5af8e2dd-702d-4066-b207-5410064c7cba (5af8e2dd-702d-4066-b207-5410064c7cba): created successfully Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c021aacf-77c2-4c6b-8e7d-0cca2169d48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Flow 'volume_create_manager' (a0381b3b-fcf1-4dda-b588-7a8f0f7aec63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-9b17515c-e43b-434a-92f9-61f65332e0ed" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] snapshot: 0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e, volume: 9b17515c-e43b-434a-92f9-61f65332e0ed, {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:09:29 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-a814af06-8672-4be8-951b-bd105509342b tempest-VolumesTestJSON-694882776 None] Created volume successfully. Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a262fb-afc0-4c05-98f9-5064d9021e3b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:29 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e Jun 25 18:09:29 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:30 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e" returned: 0 in 1.002s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b418934-b161-4f98-a857-ce9068fd5084(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:09:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] will copy from snapshot at /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:09:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Creating direct copy from snapshot {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:09:30 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[58673c3a-0c26-4824-9233-e8bbab751ed1]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:30 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 Jun 25 18:09:30 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:30 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:09:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Flow 'volume_create_manager' (d708b2b5-2b39-4c42-8e42-b99ae1c57236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b5df8c-0772-450e-8fd2-86296d554f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b5df8c-0772-450e-8fd2-86296d554f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-213510305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df272ef1-82eb-4faf-b2a5-9daae84187b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='494ff78fdef54397a6f08af394bdf51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:31Z,use_quota=True,user_id='5f89c54bfa38457c9543cffa7c62a0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47a50ae-d1c6-4a2a-9831-55a57a5eeca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47a50ae-d1c6-4a2a-9831-55a57a5eeca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5deab7f-6a7e-40b1-bf30-3b2e149acae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5deab7f-6a7e-40b1-bf30-3b2e149acae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df272ef1-82eb-4faf-b2a5-9daae84187b7', 'volume_name': 'volume-df272ef1-82eb-4faf-b2a5-9daae84187b7', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e99451-f509-49c3-8b5d-8d1108ff05a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e99451-f509-49c3-8b5d-8d1108ff05a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17315b6f-33dc-46f9-b343-1157fd3d237c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:31 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Volume df272ef1-82eb-4faf-b2a5-9daae84187b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df272ef1-82eb-4faf-b2a5-9daae84187b7', 'volume_size': 1} Jun 25 18:09:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:31 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084" returned: 0 in 1.068s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:31 devstack cinder-volume[93651]: DEBUG cinder.utils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Path /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed not found in is_blk_device check {{(pid=93651) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:09:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:31 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed Jun 25 18:09:31 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:37 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed" returned: 0 in 6.100s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:37 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeef439-d588-4319-a946-02a9abcd622f]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:37 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 Jun 25 18:09:37 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:39 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084" returned: 0 in 1.190s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Image conversion details: src /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:09:39 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Converted 1024.00 MB image at 167.83 MB/s Jun 25 18:09:39 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:39 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed Jun 25 18:09:39 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:39 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:09:39 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:39 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed" returned: 0 in 0.764s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-9b17515c-e43b-434a-92f9-61f65332e0ed" released by "_copy_volume_from_snapshot" :: held 10.297s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e-9b17515c-e43b-434a-92f9-61f65332e0ed" released by "_create_volume_from_snapshot" :: held 10.372s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.422s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.742s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-213510305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df272ef1-82eb-4faf-b2a5-9daae84187b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='494ff78fdef54397a6f08af394bdf51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:31Z,use_quota=True,user_id='5f89c54bfa38457c9543cffa7c62a0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Creating volume df272ef1-82eb-4faf-b2a5-9daae84187b7 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:09:39 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-df272ef1-82eb-4faf-b2a5-9daae84187b7 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=41,cinder:UPDATE=54,cinder:DELETE=3,cinder:INSERT=10 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:09:39 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-df272ef1-82eb-4faf-b2a5-9daae84187b7 1073741824 Jun 25 18:09:39 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:39 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=59,cinder:UPDATE=45,cinder:INSERT=9,cinder:DELETE=6 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:09:40 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ed3cff03-33b8-4784-a4bb-45230031796e tempest-GroupSnapshotsTest-215261498 None] Create group from source-snapshot-56f727e7-005a-43f9-b0d7-cd0af47195b2 completed successfully. Jun 25 18:09:40 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.959s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:09:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:09:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 8 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:09:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:09:41 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-df272ef1-82eb-4faf-b2a5-9daae84187b7 1073741824" returned: 0 in 1.211s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-df272ef1-82eb-4faf-b2a5-9daae84187b7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:41 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-df272ef1-82eb-4faf-b2a5-9daae84187b7 Jun 25 18:09:41 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-9b17515c-e43b-434a-92f9-61f65332e0ed" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-9b17515c-e43b-434a-92f9-61f65332e0ed" acquired by "delete_volume" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:41 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac651d2-21e6-405f-9a04-e29d23efc204]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:41 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed Jun 25 18:09:41 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:41 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-df272ef1-82eb-4faf-b2a5-9daae84187b7" returned: 0 in 0.869s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:09:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17315b6f-33dc-46f9-b343-1157fd3d237c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df272ef1-82eb-4faf-b2a5-9daae84187b7', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a016f4fc-0c37-45a0-9cfd-7efcc66792ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:42 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Volume volume-df272ef1-82eb-4faf-b2a5-9daae84187b7 (df272ef1-82eb-4faf-b2a5-9daae84187b7): created successfully Jun 25 18:09:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a016f4fc-0c37-45a0-9cfd-7efcc66792ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Flow 'volume_create_manager' (d708b2b5-2b39-4c42-8e42-b99ae1c57236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:42 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-71e6f180-3c7e-43f2-a661-9643c6b92ea7 tempest-VolumesTestJSON-694882776 None] Created volume successfully. Jun 25 18:09:42 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed" returned: 0 in 1.106s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:42 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed Jun 25 18:09:42 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Flow 'volume_create_manager' (12b04fab-32b3-45f4-a5ac-f7f80da3c9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1d4ad7-d3c5-4a9a-b8e0-223a1fa3df7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1d4ad7-d3c5-4a9a-b8e0-223a1fa3df7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1432909467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a1f351-fdbc-4172-8e7c-9bb05f42ceb3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='494ff78fdef54397a6f08af394bdf51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:43Z,use_quota=True,user_id='5f89c54bfa38457c9543cffa7c62a0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8637355c-b959-422d-920e-49a6fd4c6a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8637355c-b959-422d-920e-49a6fd4c6a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564fabc0-1023-4d97-b7aa-4f4ddc8ee87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564fabc0-1023-4d97-b7aa-4f4ddc8ee87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72a1f351-fdbc-4172-8e7c-9bb05f42ceb3', 'volume_name': 'volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed05590-ba9f-4e5e-8bf1-012b9899be39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed05590-ba9f-4e5e-8bf1-012b9899be39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbe4f54-8a17-4801-94a4-4e5984f7829c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:43 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Volume 72a1f351-fdbc-4172-8e7c-9bb05f42ceb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3', 'volume_size': 1} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1432909467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a1f351-fdbc-4172-8e7c-9bb05f42ceb3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='494ff78fdef54397a6f08af394bdf51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:43Z,use_quota=True,user_id='5f89c54bfa38457c9543cffa7c62a0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Creating volume 72a1f351-fdbc-4172-8e7c-9bb05f42ceb3 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:09:43 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:43 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3 1073741824 Jun 25 18:09:43 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:43 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9b17515c-e43b-434a-92f9-61f65332e0ed" returned: 0 in 0.901s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-9b17515c-e43b-434a-92f9-61f65332e0ed" released by "delete_volume" :: held 2.097s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Created reservations ['691e1d0b-3884-445f-b1bb-b6902845381b'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:09:43 devstack cinder-volume[93651]: WARNING cinder.quota [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-834597090 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-834597090, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:09:43 devstack cinder-volume[93651]: WARNING cinder.quota [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-834597090 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-834597090, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:09:43 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Created reservations ['19e46cb0-f5d8-4623-9d41-9bf0bae178b7', '90e5796d-f252-479d-af36-72166687c0ad', '9f584bb3-4111-470a-99fb-d1875ec3e4dd', 'bbfe09be-e250-4ba0-974d-168fc24f7257'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:44 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:09:44 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:44 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] group_snapshot 56f727e7-005a-43f9-b0d7-cd0af47195b2: deleting Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] group_snapshot 56f727e7-005a-43f9-b0d7-cd0af47195b2: deleting {{(pid=93651) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4653}} Jun 25 18:09:44 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3 1073741824" returned: 0 in 1.213s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-6b418934-b161-4f98-a857-ce9068fd5084" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-6b418934-b161-4f98-a857-ce9068fd5084" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] Deleting offline snapshot 0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e of volume 6b418934-b161-4f98-a857-ce9068fd5084 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:09:44 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3 Jun 25 18:09:44 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] snapshot_file for this snap is: volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9d9ed2-2785-4561-a2a6-24bf0910cdfc]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:44 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e Jun 25 18:09:44 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:45 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.265s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:45 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:09:45 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-3ac06d4a-89e1-4644-99b7-f3f6c791b0bf tempest-GroupSnapshotsTest-215261498 None] Delete group completed successfully. Jun 25 18:09:45 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3" returned: 0 in 1.194s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] <== create_volume: return (2475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:09:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.477s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbe4f54-8a17-4801-94a4-4e5984f7829c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47585025-cf85-4b17-b249-b2bfce78a8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:45 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Volume volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3 (72a1f351-fdbc-4172-8e7c-9bb05f42ceb3): created successfully Jun 25 18:09:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47585025-cf85-4b17-b249-b2bfce78a8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Flow 'volume_create_manager' (12b04fab-32b3-45f4-a5ac-f7f80da3c9a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:45 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6b6cd5f3-61aa-4b84-92d1-ce9257793319 tempest-VolumesTestJSON-694882776 None] Created volume successfully. Jun 25 18:09:45 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e" returned: 0 in 1.418s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b418934-b161-4f98-a857-ce9068fd5084(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:09:45 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c282f839-5ee8-4df6-a218-4bf1f28bc098]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:46 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 Jun 25 18:09:46 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:47 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084" returned: 0 in 1.210s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:47 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e Jun 25 18:09:47 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Acquiring lock "cinder-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Lock "cinder-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:48 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Acquiring lock "cinder-quobyte-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:48 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Lock "cinder-quobyte-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3" acquired by "delete_volume" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:48 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a7ed83-ad28-4290-9170-8ee380b0471b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:48 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3 Jun 25 18:09:48 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:48 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e" returned: 0 in 1.111s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:48 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e Jun 25 18:09:48 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:49 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3" returned: 0 in 1.034s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:49 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3 Jun 25 18:09:49 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:49 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084.0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e" returned: 0 in 0.925s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-0a5dc6a1-bb4d-41d7-bbff-f46e6a45272e" released by "_delete_snapshot" :: held 4.831s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-6b418934-b161-4f98-a857-ce9068fd5084" released by "delete_snapshot" :: held 4.887s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:49 devstack cinder-volume[93651]: WARNING cinder.quota [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-834597090 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-834597090, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:09:49 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] Created reservations ['cb44a9de-bbbb-4ded-9769-c08ef7992712', '002963a4-2dae-454e-9e15-d4ee6289c891', 'aee80f7e-7d61-412f-a056-fcbacd702f90', 'e33b86b0-9655-4622-911c-116e6dfbc7a1'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:09:49 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-65af5978-88bc-44e6-ae8a-41e36460cb86 tempest-GroupSnapshotsTest-215261498 None] group_snapshot 56f727e7-005a-43f9-b0d7-cd0af47195b2: deleted successfully Jun 25 18:09:49 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3" returned: 0 in 0.796s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Lock "cinder-quobyte-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3" released by "delete_volume" :: held 1.880s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:49 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Created reservations ['fde2b373-bc87-4164-b7dc-375f2db59615', 'd7c23ea0-e774-447a-ba36-c4b95681058b', '06c8de05-e3c5-4215-b578-7ed5fc7f46e8', '48c0b63b-037d-4ce1-962c-2dd86507da75'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:50 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:09:50 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Acquiring lock "cinder-df272ef1-82eb-4faf-b2a5-9daae84187b7-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Lock "cinder-df272ef1-82eb-4faf-b2a5-9daae84187b7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-6b418934-b161-4f98-a857-ce9068fd5084" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Acquiring lock "cinder-quobyte-df272ef1-82eb-4faf-b2a5-9daae84187b7" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-6b418934-b161-4f98-a857-ce9068fd5084" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Lock "cinder-quobyte-df272ef1-82eb-4faf-b2a5-9daae84187b7" acquired by "delete_volume" :: waited 0.077s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cfdce4-15f6-43b5-bfc2-5be79ab1acbf]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ef6f3d-ad83-484f-a766-47b01688ad2a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-df272ef1-82eb-4faf-b2a5-9daae84187b7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:50 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 Jun 25 18:09:50 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:50 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-df272ef1-82eb-4faf-b2a5-9daae84187b7 Jun 25 18:09:50 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:51 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.162s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:51 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:09:51 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Deleted volume successfully. Jun 25 18:09:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed9e1c3b-b7ab-4be1-889d-c0686182f451 tempest-VolumesTestJSON-694882776 None] Lock "cinder-72a1f351-fdbc-4172-8e7c-9bb05f42ceb3-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:51 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084" returned: 0 in 1.115s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:51 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084 Jun 25 18:09:51 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:51 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-df272ef1-82eb-4faf-b2a5-9daae84187b7" returned: 0 in 1.176s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-df272ef1-82eb-4faf-b2a5-9daae84187b7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:51 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-df272ef1-82eb-4faf-b2a5-9daae84187b7 Jun 25 18:09:51 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:52 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6b418934-b161-4f98-a857-ce9068fd5084" returned: 0 in 0.738s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-6b418934-b161-4f98-a857-ce9068fd5084" released by "delete_volume" :: held 1.959s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:52 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-df272ef1-82eb-4faf-b2a5-9daae84187b7" returned: 0 in 0.694s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Lock "cinder-quobyte-df272ef1-82eb-4faf-b2a5-9daae84187b7" released by "delete_volume" :: held 1.936s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Created reservations ['eaf410bd-0f6f-48ab-b65d-0d128e4e7af6'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Created reservations ['1af1f68f-f018-4162-8592-d1d3fb8f7424', 'b442e87b-a333-4dd6-b805-59022024cba9', '3cdb0264-b06d-4b4f-9539-31169412c2dc', '0e8a72c9-2928-4a74-a52c-9a929b298a8e'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:09:52 devstack cinder-volume[93651]: WARNING cinder.db.api [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-834597090'] Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Created reservations ['cf0fba73-7cc0-4da2-b6bc-b21ab0da9709', 'e647f534-080f-447f-b569-a70ae0d6252b', '41a955e7-3826-4491-a410-14784e116f45', '6adfa268-1b8b-4277-9983-210582768f06'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:52 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:09:52 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Acquiring lock "cinder-5af8e2dd-702d-4066-b207-5410064c7cba-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Lock "cinder-5af8e2dd-702d-4066-b207-5410064c7cba-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Acquiring lock "cinder-quobyte-5af8e2dd-702d-4066-b207-5410064c7cba" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Lock "cinder-quobyte-5af8e2dd-702d-4066-b207-5410064c7cba" acquired by "delete_volume" :: waited 0.046s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ae3ece-e3d7-4791-a959-67ae202c9854]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:09:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5af8e2dd-702d-4066-b207-5410064c7cba {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:52 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:09:52 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:53 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5af8e2dd-702d-4066-b207-5410064c7cba Jun 25 18:09:53 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:54 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.315s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:54 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:09:54 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-126e4d22-4277-4eed-a6f8-9c346aa38f62 tempest-GroupSnapshotsTest-215261498 None] Delete group completed successfully. Jun 25 18:09:54 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.669s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:54 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:09:54 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Deleted volume successfully. Jun 25 18:09:54 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-bf1e4f04-ed31-4c20-85a5-27e0c55b4a97 tempest-VolumesTestJSON-694882776 None] Lock "cinder-df272ef1-82eb-4faf-b2a5-9daae84187b7-delete_volume" released by "delete_volume" :: held 4.001s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:54 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6e070f67-dc67-4aab-9623-c3c9629754ac tempest-GroupSnapshotsTest-215261498 None] Group tempest-GroupSnapshotsTest-Group-226121531: creating Jun 25 18:09:54 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6e070f67-dc67-4aab-9623-c3c9629754ac tempest-GroupSnapshotsTest-215261498 None] Group tempest-GroupSnapshotsTest-Group-226121531: created successfully Jun 25 18:09:54 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6e070f67-dc67-4aab-9623-c3c9629754ac tempest-GroupSnapshotsTest-215261498 None] Create group completed successfully. Jun 25 18:09:54 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5af8e2dd-702d-4066-b207-5410064c7cba" returned: 0 in 1.874s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5af8e2dd-702d-4066-b207-5410064c7cba {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:54 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5af8e2dd-702d-4066-b207-5410064c7cba Jun 25 18:09:54 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:55 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5af8e2dd-702d-4066-b207-5410064c7cba" returned: 0 in 0.839s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:55 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Lock "cinder-quobyte-5af8e2dd-702d-4066-b207-5410064c7cba" released by "delete_volume" :: held 2.800s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:55 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Created reservations ['d4a85960-1b49-44cb-b189-62a430359374', '8eea368d-fee3-4d22-a267-eb5031a50455', '68b81e51-7b5e-4ef5-a096-7dd0c448ed3e', '36efca96-e1e3-4dab-829c-326d52e1257b'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:09:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:55 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:09:55 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Flow 'volume_create_manager' (747f45e4-6686-449a-a77a-216c8da4bc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4746836f-1983-4f23-a13a-7c12e9f343eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4746836f-1983-4f23-a13a-7c12e9f343eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1802828980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b0a0366-0ae3-4917-868b-b15c6280edf1,host='devstack@QuobyteHD#QuobyteHD',id=cfe30081-4099-42fb-ae31-3eac79050b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a272b053d6b2442dae9ec948cea91aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:56Z,use_quota=True,user_id='2ba76bbf9048459a89ce70fd8a59ce8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e8014a-45fa-4a78-9e5d-17c523ff5d6e),volume_type_id=05e8014a-45fa-4a78-9e5d-17c523ff5d6e)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05dc2ecc-0b14-4780-a445-28d19ce1a26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05dc2ecc-0b14-4780-a445-28d19ce1a26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d358d9-9e12-4ced-804f-210e3e383c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d358d9-9e12-4ced-804f-210e3e383c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe30081-4099-42fb-ae31-3eac79050b6a', 'volume_name': 'volume-cfe30081-4099-42fb-ae31-3eac79050b6a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07df301a-b31c-41b8-95e8-1ddd09493663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07df301a-b31c-41b8-95e8-1ddd09493663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f0b6e4-9aff-4923-9941-204011d3b873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:56 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Volume cfe30081-4099-42fb-ae31-3eac79050b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe30081-4099-42fb-ae31-3eac79050b6a', 'volume_size': 1} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b0a0366-0ae3-4917-868b-b15c6280edf1,created_at=2026-06-25T16:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1802828980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b0a0366-0ae3-4917-868b-b15c6280edf1,host='devstack@QuobyteHD#QuobyteHD',id=cfe30081-4099-42fb-ae31-3eac79050b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a272b053d6b2442dae9ec948cea91aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:09:56Z,use_quota=True,user_id='2ba76bbf9048459a89ce70fd8a59ce8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e8014a-45fa-4a78-9e5d-17c523ff5d6e),volume_type_id=05e8014a-45fa-4a78-9e5d-17c523ff5d6e)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Creating volume cfe30081-4099-42fb-ae31-3eac79050b6a {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:09:56 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:56 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a 1073741824 Jun 25 18:09:56 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:56 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.163s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:09:56 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Deleted volume successfully. Jun 25 18:09:56 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5e603b34-8829-49a4-895a-ae526297277c tempest-VolumesTestJSON-694882776 None] Lock "cinder-5af8e2dd-702d-4066-b207-5410064c7cba-delete_volume" released by "delete_volume" :: held 4.274s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:09:58 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a 1073741824" returned: 0 in 1.448s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:09:58 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a Jun 25 18:09:58 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:09:59 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Jun 25 18:09:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a" returned: 0 in 1.366s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:09:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] <== create_volume: return (2945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:09:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.948s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:09:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f0b6e4-9aff-4923-9941-204011d3b873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe30081-4099-42fb-ae31-3eac79050b6a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5d70c5-8be2-460d-9ed5-6c40fa16a52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:09:59 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Volume volume-cfe30081-4099-42fb-ae31-3eac79050b6a (cfe30081-4099-42fb-ae31-3eac79050b6a): created successfully Jun 25 18:09:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5d70c5-8be2-460d-9ed5-6c40fa16a52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:09:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Flow 'volume_create_manager' (747f45e4-6686-449a-a77a-216c8da4bc14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:09:59 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2a256f55-053c-48de-a873-d633386ca6fb tempest-GroupSnapshotsTest-215261498 None] Created volume successfully. Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Flow 'volume_create_manager' (14e48829-2d4a-412f-84df-2504f1d4753a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c7b744-c063-42ab-b2d0-102e53fea407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c7b744-c063-42ab-b2d0-102e53fea407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-160684017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b0a0366-0ae3-4917-868b-b15c6280edf1,host='devstack@QuobyteHD#QuobyteHD',id=d2facf7d-d7eb-4fac-a86a-0f19f0f58142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a272b053d6b2442dae9ec948cea91aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:02Z,use_quota=True,user_id='2ba76bbf9048459a89ce70fd8a59ce8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e8014a-45fa-4a78-9e5d-17c523ff5d6e),volume_type_id=05e8014a-45fa-4a78-9e5d-17c523ff5d6e)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b849334c-8abf-446a-a5b8-54a68273fefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b849334c-8abf-446a-a5b8-54a68273fefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dff6482-afbd-448e-8268-624ab167331f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dff6482-afbd-448e-8268-624ab167331f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2facf7d-d7eb-4fac-a86a-0f19f0f58142', 'volume_name': 'volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8731b401-790f-4263-9f6e-b1a17eff40bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8731b401-790f-4263-9f6e-b1a17eff40bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0807adfd-7b69-4c6c-8dfa-10c4b2fc4f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:01 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Volume d2facf7d-d7eb-4fac-a86a-0f19f0f58142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142', 'volume_size': 1} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b0a0366-0ae3-4917-868b-b15c6280edf1,created_at=2026-06-25T16:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-160684017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b0a0366-0ae3-4917-868b-b15c6280edf1,host='devstack@QuobyteHD#QuobyteHD',id=d2facf7d-d7eb-4fac-a86a-0f19f0f58142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a272b053d6b2442dae9ec948cea91aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:02Z,use_quota=True,user_id='2ba76bbf9048459a89ce70fd8a59ce8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e8014a-45fa-4a78-9e5d-17c523ff5d6e),volume_type_id=05e8014a-45fa-4a78-9e5d-17c523ff5d6e)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Creating volume d2facf7d-d7eb-4fac-a86a-0f19f0f58142 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:10:01 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:10:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:01 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 1073741824 Jun 25 18:10:01 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:03 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 1073741824" returned: 0 in 1.389s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:03 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 Jun 25 18:10:03 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:04 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142" returned: 0 in 1.495s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] <== create_volume: return (2943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:10:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.947s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0807adfd-7b69-4c6c-8dfa-10c4b2fc4f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87db6582-7369-43b8-9ce5-f858dbf2dea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:04 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Volume volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 (d2facf7d-d7eb-4fac-a86a-0f19f0f58142): created successfully Jun 25 18:10:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87db6582-7369-43b8-9ce5-f858dbf2dea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Flow 'volume_create_manager' (14e48829-2d4a-412f-84df-2504f1d4753a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-a897577a-527c-4fee-9bde-d28dfb5ae97b tempest-GroupSnapshotsTest-215261498 None] Created volume successfully. Jun 25 18:10:06 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-14f28fe4-5028-4d32-804e-b4dffebd6954 tempest-GroupSnapshotsTest-215261498 None] Update group completed successfully. Jun 25 18:10:07 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-33d2a131-3e4e-4594-b2e9-2c27c4c47734 tempest-GroupSnapshotsTest-215261498 None] Update group completed successfully. Jun 25 18:10:08 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-8d6ee8a2-35b8-47a2-84d2-833ab7986e73 tempest-GroupSnapshotsTest-215261498 None] Update group completed successfully. Jun 25 18:10:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-eff91db6-038f-463c-b0bd-c869a3323696 tempest-GroupSnapshotsTest-215261498 None] Update group completed successfully. Jun 25 18:10:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d49660dd-e0ae-421e-9742-b9e1839bb2ff tempest-GroupSnapshotsV319Test-2135919658 None] Group tempest-GroupSnapshotsV319Test-Group-1422984689: creating Jun 25 18:10:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d49660dd-e0ae-421e-9742-b9e1839bb2ff tempest-GroupSnapshotsV319Test-2135919658 None] Group tempest-GroupSnapshotsV319Test-Group-1422984689: created successfully Jun 25 18:10:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d49660dd-e0ae-421e-9742-b9e1839bb2ff tempest-GroupSnapshotsV319Test-2135919658 None] Create group completed successfully. Jun 25 18:10:11 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] GroupSnapshot c88e1264-a566-4ce9-8e75-9bd93ae2c5d2: creating. Jun 25 18:10:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Group snapshot c88e1264-a566-4ce9-8e75-9bd93ae2c5d2: creating. {{(pid=93651) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4478}} Jun 25 18:10:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Creating offline snapshot 0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 of volume d2facf7d-d7eb-4fac-a86a-0f19f0f58142 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:10:11 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[845faffc-cb7a-4c6b-9db0-9e1ff2145b5b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:12 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 Jun 25 18:10:12 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:12 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:10:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Flow 'volume_create_manager' (72e4afbd-3fb0-4727-ba5d-41cda0de2517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b319cf77-9b79-4d1b-9450-bf518d8d0482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b319cf77-9b79-4d1b-9450-bf518d8d0482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1144810352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf8abb10-a864-4318-9966-099b53c300c7,host='devstack@QuobyteHD#QuobyteHD',id=152d1636-186c-4ba1-8581-5e78423d7ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bedb97d45f49c8b5dbff5fde6f9a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:12Z,use_quota=True,user_id='9bab294655a24ea080a1e8aa5277fcbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3daf4236-2bf8-4c08-8042-99c74837cdad),volume_type_id=3daf4236-2bf8-4c08-8042-99c74837cdad)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79918e63-a187-4dab-91da-314ea1fcaf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79918e63-a187-4dab-91da-314ea1fcaf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbfe6c68-36f1-4773-9bd9-c3eaeaf63488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbfe6c68-36f1-4773-9bd9-c3eaeaf63488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '152d1636-186c-4ba1-8581-5e78423d7ce3', 'volume_name': 'volume-152d1636-186c-4ba1-8581-5e78423d7ce3', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80fe548-5f59-4028-804a-756efcd918ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80fe548-5f59-4028-804a-756efcd918ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c4406b-da65-4afc-99d2-ca469457fd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:12 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Volume 152d1636-186c-4ba1-8581-5e78423d7ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-152d1636-186c-4ba1-8581-5e78423d7ce3', 'volume_size': 1} Jun 25 18:10:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:13 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142" returned: 0 in 1.068s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:13 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 1G Jun 25 18:10:13 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:13 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 1G" returned: 0 in 0.871s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:13 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 Jun 25 18:10:13 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:14 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9" returned: 0 in 0.846s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:14 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:10:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:14 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 Jun 25 18:10:14 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:15 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9" returned: 0 in 0.758s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:15 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.info Jun 25 18:10:15 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:16 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.info" returned: 0 in 0.741s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:16 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:10:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:16 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.info Jun 25 18:10:16 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:17 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.info" returned: 0 in 0.811s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.219s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Creating offline snapshot 9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 of volume cfe30081-4099-42fb-ae31-3eac79050b6a {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:10:17 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21cb985-8e37-49ac-a4e9-d3052e6f7b77]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:17 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a Jun 25 18:10:17 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:18 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a" returned: 0 in 0.932s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:18 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 1G Jun 25 18:10:18 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:20 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 1G" returned: 0 in 1.916s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe30081-4099-42fb-ae31-3eac79050b6a -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:20 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe30081-4099-42fb-ae31-3eac79050b6a -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 Jun 25 18:10:20 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:21 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe30081-4099-42fb-ae31-3eac79050b6a -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682" returned: 0 in 1.087s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:21 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:10:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:21 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 Jun 25 18:10:21 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:22 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682" returned: 0 in 1.253s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:22 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.info Jun 25 18:10:22 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:23 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.info" returned: 0 in 1.332s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:23 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:10:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:23 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.info Jun 25 18:10:23 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:24 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.info" returned: 0 in 0.992s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.671s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.149s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bf8abb10-a864-4318-9966-099b53c300c7,created_at=2026-06-25T16:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1144810352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf8abb10-a864-4318-9966-099b53c300c7,host='devstack@QuobyteHD#QuobyteHD',id=152d1636-186c-4ba1-8581-5e78423d7ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bedb97d45f49c8b5dbff5fde6f9a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:12Z,use_quota=True,user_id='9bab294655a24ea080a1e8aa5277fcbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3daf4236-2bf8-4c08-8042-99c74837cdad),volume_type_id=3daf4236-2bf8-4c08-8042-99c74837cdad)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:10:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Creating volume 152d1636-186c-4ba1-8581-5e78423d7ce3 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:10:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:10:24 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:10:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:24 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3 1073741824 Jun 25 18:10:24 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:25 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-28002c8f-de10-4f26-b0e4-a434ff09ae48 tempest-GroupSnapshotsTest-215261498 None] group_snapshot c88e1264-a566-4ce9-8e75-9bd93ae2c5d2: created successfully Jun 25 18:10:26 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3 1073741824" returned: 0 in 1.345s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:26 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] group_snapshot c88e1264-a566-4ce9-8e75-9bd93ae2c5d2: deleting Jun 25 18:10:26 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3 Jun 25 18:10:26 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] group_snapshot c88e1264-a566-4ce9-8e75-9bd93ae2c5d2: deleting {{(pid=93651) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4653}} Jun 25 18:10:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-d2facf7d-d7eb-4fac-a86a-0f19f0f58142" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-d2facf7d-d7eb-4fac-a86a-0f19f0f58142" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-0ed3dfa9-c60f-4a09-971c-c3b37c6065c9" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-0ed3dfa9-c60f-4a09-971c-c3b37c6065c9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Deleting offline snapshot 0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 of volume d2facf7d-d7eb-4fac-a86a-0f19f0f58142 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:10:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] snapshot_file for this snap is: volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:10:26 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[3647b58d-fcd8-4b83-a097-c0e8ccd525cf]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:26 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 Jun 25 18:10:26 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:27 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3" returned: 0 in 1.010s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] <== create_volume: return (2465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:10:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.470s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c4406b-da65-4afc-99d2-ca469457fd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152d1636-186c-4ba1-8581-5e78423d7ce3', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a57125b-1745-4aac-ad19-d8e418bc10db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:27 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Volume volume-152d1636-186c-4ba1-8581-5e78423d7ce3 (152d1636-186c-4ba1-8581-5e78423d7ce3): created successfully Jun 25 18:10:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a57125b-1745-4aac-ad19-d8e418bc10db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Flow 'volume_create_manager' (72e4afbd-3fb0-4727-ba5d-41cda0de2517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:27 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-9c89814f-1d6e-4e4d-95ed-1a94eed2ad9f tempest-GroupSnapshotsV319Test-2135919658 None] Created volume successfully. Jun 25 18:10:27 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9" returned: 0 in 1.097s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:10:27 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba83f07-fd63-4c2b-a01e-87e6c1c2c84b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:27 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 Jun 25 18:10:27 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:28 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] GroupSnapshot d63fedd5-8264-4052-bee8-99fabd5fb4af: creating. Jun 25 18:10:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] Group snapshot d63fedd5-8264-4052-bee8-99fabd5fb4af: creating. {{(pid=93651) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4478}} Jun 25 18:10:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] Creating offline snapshot 2b6602fb-e03d-4a44-82cd-cb46e052ddaa of volume 152d1636-186c-4ba1-8581-5e78423d7ce3 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:10:28 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142" returned: 0 in 0.829s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:28 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5a3478-7633-4d1d-9b99-c88bdcf1cd3b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:28 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 Jun 25 18:10:28 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:28 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3 Jun 25 18:10:28 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:29 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3" returned: 0 in 1.070s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:29 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa 1G Jun 25 18:10:29 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:29 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9" returned: 0 in 1.209s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:29 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9 Jun 25 18:10:29 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:30 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142.0ed3dfa9-c60f-4a09-971c-c3b37c6065c9" returned: 0 in 0.828s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:30 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-0ed3dfa9-c60f-4a09-971c-c3b37c6065c9" released by "_delete_snapshot" :: held 4.111s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:30 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-d2facf7d-d7eb-4fac-a86a-0f19f0f58142" released by "delete_snapshot" :: held 4.148s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:30 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-cfe30081-4099-42fb-ae31-3eac79050b6a" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:30 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-cfe30081-4099-42fb-ae31-3eac79050b6a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:30 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-9d8f8e15-c0ac-4670-a7b4-4f60f8afb682" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:30 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-9d8f8e15-c0ac-4670-a7b4-4f60f8afb682" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Deleting offline snapshot 9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 of volume cfe30081-4099-42fb-ae31-3eac79050b6a {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:10:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] snapshot_file for this snap is: volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:10:30 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5825d91-e0c9-44eb-b2eb-6416c118adfc]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:30 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa 1G" returned: 0 in 1.184s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152d1636-186c-4ba1-8581-5e78423d7ce3 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:30 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152d1636-186c-4ba1-8581-5e78423d7ce3 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa Jun 25 18:10:30 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:30 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 Jun 25 18:10:30 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:31 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152d1636-186c-4ba1-8581-5e78423d7ce3 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa" returned: 0 in 1.060s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:31 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:10:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:31 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa Jun 25 18:10:31 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:31 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682" returned: 0 in 1.176s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:31 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfe30081-4099-42fb-ae31-3eac79050b6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:10:31 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef5a7f4-a9fd-4fdf-a058-2f1635f7de26]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:32 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a Jun 25 18:10:32 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:33 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-cbf97101-f584-4b9e-8198-6699a659d8c9 req-838ce75d-aeca-43e1-b840-a5afbaa08141 tempest-AttachVolumeNegativeTest-510956435 None] Terminate volume connection completed successfully. Jun 25 18:10:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-cbf97101-f584-4b9e-8198-6699a659d8c9 req-838ce75d-aeca-43e1-b840-a5afbaa08141 tempest-AttachVolumeNegativeTest-510956435 None] Deleting attachment a3be84c7-d9e8-414c-b319-71a837d9e60d. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:10:33 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a" returned: 0 in 1.433s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:33 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 Jun 25 18:10:33 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:33 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa" returned: 0 in 1.609s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:33 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.info Jun 25 18:10:33 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:34 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.info" returned: 0 in 1.325s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:34 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:10:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:34 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.info Jun 25 18:10:34 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:34 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682" returned: 0 in 1.682s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:34 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682 Jun 25 18:10:34 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:35 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.info" returned: 0 in 0.804s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.209s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:35 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-8486f9a1-b033-4d5a-940b-72346e40f587 tempest-GroupSnapshotsV319Test-2135919658 None] group_snapshot d63fedd5-8264-4052-bee8-99fabd5fb4af: created successfully Jun 25 18:10:35 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a.9d8f8e15-c0ac-4670-a7b4-4f60f8afb682" returned: 0 in 0.940s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-9d8f8e15-c0ac-4670-a7b4-4f60f8afb682" released by "_delete_snapshot" :: held 5.413s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-cfe30081-4099-42fb-ae31-3eac79050b6a" released by "delete_snapshot" :: held 5.454s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:36 devstack cinder-volume[93651]: WARNING cinder.quota [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1835912931 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1835912931, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:10:36 devstack cinder-volume[93651]: WARNING cinder.quota [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1835912931 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1835912931, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:10:36 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Created reservations ['f0ed538e-202e-4499-adff-8f896bbba107', '175a5e9b-f2db-4e14-9fe0-5ed334e50796', '0fb6f391-1207-43ee-8a97-443e467376fb', '7180f431-3408-4da9-8e16-7854d8f0c26e'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:10:36 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] Created reservations ['e984bd3b-c3b1-40e1-9adc-87c21232e076', 'b67ae70b-2f46-419b-b73a-8ac4385e97c7', '592f9981-8f13-4c0c-91bd-27fe00c236f0', 'ab2332a6-cb91-4525-bec9-f12b382d9cd0'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:10:36 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f199334e-0cae-4883-b9c7-2f541efe4bcb tempest-GroupSnapshotsTest-215261498 None] group_snapshot c88e1264-a566-4ce9-8e75-9bd93ae2c5d2: deleted successfully Jun 25 18:10:36 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] group_snapshot d63fedd5-8264-4052-bee8-99fabd5fb4af: deleting Jun 25 18:10:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] group_snapshot d63fedd5-8264-4052-bee8-99fabd5fb4af: deleting {{(pid=93651) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4653}} Jun 25 18:10:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Acquiring lock "cinder-quobyte-152d1636-186c-4ba1-8581-5e78423d7ce3" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Lock "cinder-quobyte-152d1636-186c-4ba1-8581-5e78423d7ce3" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Acquiring lock "cinder-quobyte-2b6602fb-e03d-4a44-82cd-cb46e052ddaa" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Lock "cinder-quobyte-2b6602fb-e03d-4a44-82cd-cb46e052ddaa" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Deleting offline snapshot 2b6602fb-e03d-4a44-82cd-cb46e052ddaa of volume 152d1636-186c-4ba1-8581-5e78423d7ce3 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:10:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] snapshot_file for this snap is: volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:10:36 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f02731f-820a-4eb1-8e06-61a80790be03]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:37 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa Jun 25 18:10:37 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:37 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa" returned: 0 in 0.909s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-152d1636-186c-4ba1-8581-5e78423d7ce3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:10:37 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6a63a0-cc92-45b2-b4f3-0574e4db328e]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:38 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3 Jun 25 18:10:38 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-cfe30081-4099-42fb-ae31-3eac79050b6a" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-cfe30081-4099-42fb-ae31-3eac79050b6a" acquired by "delete_volume" :: waited 0.030s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:38 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[874e32d1-e619-4784-97b3-db991a2f8756]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:38 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a Jun 25 18:10:38 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:39 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3" returned: 0 in 1.170s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:39 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa Jun 25 18:10:39 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:10:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:39 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:10:39 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a" returned: 0 in 0.987s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:39 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:39 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a Jun 25 18:10:39 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:40 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa" returned: 0 in 1.032s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:40 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa Jun 25 18:10:40 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:40 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.973s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:10:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:10:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 8 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:10:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:10:40 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cfe30081-4099-42fb-ae31-3eac79050b6a" returned: 0 in 0.935s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:40 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-cfe30081-4099-42fb-ae31-3eac79050b6a" released by "delete_volume" :: held 2.098s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:40 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-d2facf7d-d7eb-4fac-a86a-0f19f0f58142" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:40 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-d2facf7d-d7eb-4fac-a86a-0f19f0f58142" acquired by "delete_volume" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:40 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a42d13-d77b-4289-a730-3b5c9459d6e2]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:40 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 Jun 25 18:10:40 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:41 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3.2b6602fb-e03d-4a44-82cd-cb46e052ddaa" returned: 0 in 0.942s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Lock "cinder-quobyte-2b6602fb-e03d-4a44-82cd-cb46e052ddaa" released by "_delete_snapshot" :: held 4.271s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Lock "cinder-quobyte-152d1636-186c-4ba1-8581-5e78423d7ce3" released by "delete_snapshot" :: held 4.326s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:41 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=90,cinder:UPDATE=87,cinder:INSERT=22,cinder:DELETE=4 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:10:41 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=95,cinder:SELECT=92,cinder:DELETE=4,cinder:INSERT=20 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:10:41 devstack cinder-volume[93651]: WARNING cinder.quota [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1998006535 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1998006535, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:10:41 devstack cinder-volume[93651]: WARNING cinder.quota [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1998006535 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1998006535, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:10:41 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] Created reservations ['204b4e3f-005e-4ba8-a63e-7f4013826eab', 'b664af83-64ba-4fc5-aac8-eadf628acbe7', '0687bfd8-d93d-4f9c-9392-080399653d3a', '01441021-abe5-40dd-b68b-66ac53c83384'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:10:41 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2a70028c-2c0b-4b09-90fb-3906ea9a9fdc tempest-GroupSnapshotsV319Test-2135919658 None] group_snapshot d63fedd5-8264-4052-bee8-99fabd5fb4af: deleted successfully Jun 25 18:10:41 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142" returned: 0 in 1.246s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:41 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142 Jun 25 18:10:41 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:42 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d2facf7d-d7eb-4fac-a86a-0f19f0f58142" returned: 0 in 1.273s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-d2facf7d-d7eb-4fac-a86a-0f19f0f58142" released by "delete_volume" :: held 2.643s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Acquiring lock "cinder-quobyte-152d1636-186c-4ba1-8581-5e78423d7ce3" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:10:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Lock "cinder-quobyte-152d1636-186c-4ba1-8581-5e78423d7ce3" acquired by "delete_volume" :: waited 0.074s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:10:43 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7aa86c-3941-45f2-a26b-92797e27a28e]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:43 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Created reservations ['f0ed1433-8c22-4a2b-8e57-48feead914c8'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:10:43 devstack cinder-volume[93651]: WARNING cinder.quota [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1835912931 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1835912931, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:10:43 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Created reservations ['0a2aa325-ab66-4d1d-a4eb-b1e31c122bd6', 'f6bef7ea-b8ea-4524-9ac0-25565da6693e', 'ba66a734-160c-4442-b524-20c7532cb8b2', '96edb298-d972-49b7-a080-e82fda4ec9e8'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:10:43 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3 Jun 25 18:10:43 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:43 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Created reservations ['abf43d3c-23af-4e94-b2d8-0188760188a4', '1a677d10-72d6-4067-a0b5-57bee4d21bd8', 'ec07330a-87db-468e-8f5f-3bd8f66462c6', '99be1ca7-a2a2-4bab-a4f8-05fbf46a3501'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:10:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:43 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:10:43 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:44 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.274s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:44 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:10:44 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-79138ba5-306f-4d54-b773-510d52a80574 tempest-GroupSnapshotsTest-215261498 None] Delete group completed successfully. Jun 25 18:10:45 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-fc0e3686-ea75-4059-b04b-0896675627a0 tempest-GroupSnapshotsTest-215261498 None] Group tempest-GroupSnapshotsTest-Group-2106713876: creating Jun 25 18:10:45 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3" returned: 0 in 1.954s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:45 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3 Jun 25 18:10:45 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:45 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-fc0e3686-ea75-4059-b04b-0896675627a0 tempest-GroupSnapshotsTest-215261498 None] Group tempest-GroupSnapshotsTest-Group-2106713876: created successfully Jun 25 18:10:45 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-fc0e3686-ea75-4059-b04b-0896675627a0 tempest-GroupSnapshotsTest-215261498 None] Create group completed successfully. Jun 25 18:10:46 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-152d1636-186c-4ba1-8581-5e78423d7ce3" returned: 0 in 1.163s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:46 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Lock "cinder-quobyte-152d1636-186c-4ba1-8581-5e78423d7ce3" released by "delete_volume" :: held 3.282s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:10:46 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Created reservations ['fbfc8648-46fb-4227-b503-8c9538ec6918'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:10:46 devstack cinder-volume[93651]: WARNING cinder.quota [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1998006535 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1998006535, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:10:46 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Created reservations ['bb47b22d-3827-428f-8482-9f740af03030', 'd0ecc3ef-b889-4617-9792-02fd1ef598bd', '9fc9a60b-7d4d-4104-a471-1a98e874a935', '59a45333-8649-4c0d-9afe-0cb93699dde3'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:10:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:47 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:10:47 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Flow 'volume_create_manager' (d0b24407-56b1-4f59-ab88-a4217bb28ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bac5bd-6fbb-4568-b5b6-46ddce049d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bac5bd-6fbb-4568-b5b6-46ddce049d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-70903174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61323858-0cc1-44d7-979b-bb037fc78fa0,host='devstack@QuobyteHD#QuobyteHD',id=b27bb511-80a5-4d90-b9ab-8a78d345cb4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a272b053d6b2442dae9ec948cea91aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:48Z,use_quota=True,user_id='2ba76bbf9048459a89ce70fd8a59ce8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92473576-ca8a-4824-9abd-34231ab5fa34),volume_type_id=92473576-ca8a-4824-9abd-34231ab5fa34)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16086082-cc5b-4430-a5e9-b5c0a3e86344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16086082-cc5b-4430-a5e9-b5c0a3e86344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7ac907-cec2-4379-9fb8-ee346fe9dfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7ac907-cec2-4379-9fb8-ee346fe9dfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b27bb511-80a5-4d90-b9ab-8a78d345cb4e', 'volume_name': 'volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8220cab-08a9-432f-a5aa-33f1d8a4a394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8220cab-08a9-432f-a5aa-33f1d8a4a394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd20eca-01f8-4654-869c-e67eb97cd57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:47 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Volume b27bb511-80a5-4d90-b9ab-8a78d345cb4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e', 'volume_size': 1} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=61323858-0cc1-44d7-979b-bb037fc78fa0,created_at=2026-06-25T16:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-70903174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61323858-0cc1-44d7-979b-bb037fc78fa0,host='devstack@QuobyteHD#QuobyteHD',id=b27bb511-80a5-4d90-b9ab-8a78d345cb4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a272b053d6b2442dae9ec948cea91aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:48Z,use_quota=True,user_id='2ba76bbf9048459a89ce70fd8a59ce8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92473576-ca8a-4824-9abd-34231ab5fa34),volume_type_id=92473576-ca8a-4824-9abd-34231ab5fa34)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Creating volume b27bb511-80a5-4d90-b9ab-8a78d345cb4e {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:10:48 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:10:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:48 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e 1073741824 Jun 25 18:10:48 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:48 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.528s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:48 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:10:48 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-9f738bc0-57d6-45be-9e62-f359bd9ddc41 tempest-GroupSnapshotsV319Test-2135919658 None] Delete group completed successfully. Jun 25 18:10:49 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e 1073741824" returned: 0 in 1.557s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:49 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e Jun 25 18:10:49 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e" returned: 0 in 0.855s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] <== create_volume: return (2551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:10:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.561s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:50 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd20eca-01f8-4654-869c-e67eb97cd57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00af947d-6382-434b-b689-c6fe50886148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:50 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Volume volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e (b27bb511-80a5-4d90-b9ab-8a78d345cb4e): created successfully Jun 25 18:10:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00af947d-6382-434b-b689-c6fe50886148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Flow 'volume_create_manager' (d0b24407-56b1-4f59-ab88-a4217bb28ed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:50 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-eb9faa79-f2df-4e3b-88d2-a3d36c70a5e1 tempest-GroupSnapshotsTest-215261498 None] Created volume successfully. Jun 25 18:10:52 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] GroupSnapshot f49c84f1-6bd7-4d69-9584-a9bff7978b84: creating. Jun 25 18:10:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] Group snapshot f49c84f1-6bd7-4d69-9584-a9bff7978b84: creating. {{(pid=93651) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4478}} Jun 25 18:10:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] Creating offline snapshot 29ea31c2-79ee-410b-bc52-915ac31eb918 of volume b27bb511-80a5-4d90-b9ab-8a78d345cb4e {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:10:52 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28d9b8e-9cfc-4113-8407-c48bb0f3f2fa]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:10:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:52 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e Jun 25 18:10:52 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:53 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e" returned: 0 in 1.090s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:53 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 1G Jun 25 18:10:53 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:54 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 1G" returned: 0 in 0.993s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:54 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 Jun 25 18:10:54 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:55 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918" returned: 0 in 1.012s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:55 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:10:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:55 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 Jun 25 18:10:55 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:56 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918" returned: 0 in 0.874s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:56 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.info Jun 25 18:10:56 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:56 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:10:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Flow 'volume_create_manager' (dbcfb199-0fad-41f8-a829-e54bbf643b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:10:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7013b752-5358-4958-83dc-f51d16a5c10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7013b752-5358-4958-83dc-f51d16a5c10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-445065242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a2f678-6f43-4532-8acf-818cca2989c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d7b467aa2845608c03b177ea2146d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:57Z,use_quota=True,user_id='a2f966221bfb4bf38dea506222cf5ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c51b87-c7f6-4735-8323-3af9b410e9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c51b87-c7f6-4735-8323-3af9b410e9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc1e3fb-d498-4733-824f-a57c705782bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc1e3fb-d498-4733-824f-a57c705782bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11a2f678-6f43-4532-8acf-818cca2989c4', 'volume_name': 'volume-11a2f678-6f43-4532-8acf-818cca2989c4', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306d47ad-6693-4991-ab25-990922c24228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306d47ad-6693-4991-ab25-990922c24228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:10:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7fd3a7f-b0bb-418e-a990-f8847da11a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:10:56 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Volume 11a2f678-6f43-4532-8acf-818cca2989c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11a2f678-6f43-4532-8acf-818cca2989c4', 'volume_size': 1} Jun 25 18:10:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:57 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.info" returned: 0 in 1.109s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:57 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:10:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:57 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.info Jun 25 18:10:57 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:58 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Jun 25 18:10:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.info" returned: 0 in 1.083s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:10:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.301s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-445065242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a2f678-6f43-4532-8acf-818cca2989c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d7b467aa2845608c03b177ea2146d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:10:57Z,use_quota=True,user_id='a2f966221bfb4bf38dea506222cf5ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:10:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Creating volume 11a2f678-6f43-4532-8acf-818cca2989c4 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:10:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:10:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:10:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:10:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:10:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:10:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:10:58 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:10:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11a2f678-6f43-4532-8acf-818cca2989c4 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:10:58 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11a2f678-6f43-4532-8acf-818cca2989c4 1073741824 Jun 25 18:10:58 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:10:58 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d4d97ed8-973b-4a2c-929e-a468028ba786 tempest-GroupSnapshotsTest-215261498 None] group_snapshot f49c84f1-6bd7-4d69-9584-a9bff7978b84: created successfully Jun 25 18:11:00 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11a2f678-6f43-4532-8acf-818cca2989c4 1073741824" returned: 0 in 1.497s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:00 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] group_snapshot f49c84f1-6bd7-4d69-9584-a9bff7978b84: deleting Jun 25 18:11:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] group_snapshot f49c84f1-6bd7-4d69-9584-a9bff7978b84: deleting {{(pid=93651) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4653}} Jun 25 18:11:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11a2f678-6f43-4532-8acf-818cca2989c4 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-b27bb511-80a5-4d90-b9ab-8a78d345cb4e" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:00 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11a2f678-6f43-4532-8acf-818cca2989c4 Jun 25 18:11:00 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-b27bb511-80a5-4d90-b9ab-8a78d345cb4e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-29ea31c2-79ee-410b-bc52-915ac31eb918" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-29ea31c2-79ee-410b-bc52-915ac31eb918" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Deleting offline snapshot 29ea31c2-79ee-410b-bc52-915ac31eb918 of volume b27bb511-80a5-4d90-b9ab-8a78d345cb4e {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:11:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] snapshot_file for this snap is: volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:11:00 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dba8722-0967-4121-9ac5-507f41e567ba]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:00 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 Jun 25 18:11:00 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:01 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11a2f678-6f43-4532-8acf-818cca2989c4" returned: 0 in 1.076s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] <== create_volume: return (2682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:11:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.690s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7fd3a7f-b0bb-418e-a990-f8847da11a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11a2f678-6f43-4532-8acf-818cca2989c4', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882157b2-ae98-4e76-8de0-d7cac4c3156d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:01 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Volume volume-11a2f678-6f43-4532-8acf-818cca2989c4 (11a2f678-6f43-4532-8acf-818cca2989c4): created successfully Jun 25 18:11:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882157b2-ae98-4e76-8de0-d7cac4c3156d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Flow 'volume_create_manager' (dbcfb199-0fad-41f8-a829-e54bbf643b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:01 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-dd1f94c1-0616-4403-b999-6bd139f750b0 tempest-ServersNegativeTestJSON-1429313265 None] Created volume successfully. Jun 25 18:11:01 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918" returned: 0 in 1.032s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:11:01 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfdb35e-cf44-4c85-8965-cb82a3b18c6d]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:01 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e Jun 25 18:11:01 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:02 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e" returned: 0 in 0.897s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:02 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 Jun 25 18:11:02 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:02 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-47c11273-6ea7-49e4-aa62-d33d35579458 tempest-GroupsTest-471130289 None] Group tempest-Group1-590484279: creating Jun 25 18:11:02 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-47c11273-6ea7-49e4-aa62-d33d35579458 tempest-GroupsTest-471130289 None] Group tempest-Group1-590484279: created successfully Jun 25 18:11:03 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-47c11273-6ea7-49e4-aa62-d33d35579458 tempest-GroupsTest-471130289 None] Create group completed successfully. Jun 25 18:11:03 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918" returned: 0 in 1.017s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:03 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918 Jun 25 18:11:03 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:04 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e.29ea31c2-79ee-410b-bc52-915ac31eb918" returned: 0 in 0.894s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-29ea31c2-79ee-410b-bc52-915ac31eb918" released by "_delete_snapshot" :: held 4.029s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-b27bb511-80a5-4d90-b9ab-8a78d345cb4e" released by "delete_snapshot" :: held 4.106s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:04 devstack cinder-volume[93651]: WARNING cinder.quota [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1183641149 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1183641149, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:11:04 devstack cinder-volume[93651]: WARNING cinder.quota [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1183641149 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1183641149, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] Created reservations ['b0b6ef2b-a91f-4b17-a788-f0a26728dc6a', '3e3e2971-cd4e-4aa7-a46d-a14ff8f382b5', 'fe1b2396-1d90-4ef7-a1fc-6ea841270884', '289358bd-6679-4fbf-b7cc-b9c55cd1c47e'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Flow 'volume_create_manager' (6665e52d-5c82-4b2f-b816-c29245ded924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be426617-a329-4238-bf18-a1a6da4ccd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be426617-a329-4238-bf18-a1a6da4ccd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-693436626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c26652-5dae-47c0-854c-8b664d1ed653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d7b467aa2845608c03b177ea2146d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:05Z,use_quota=True,user_id='a2f966221bfb4bf38dea506222cf5ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952610c7-9996-48a6-bd95-d6d8d479b314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952610c7-9996-48a6-bd95-d6d8d479b314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72660683-2b32-4245-a3fd-ed8b550671a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72660683-2b32-4245-a3fd-ed8b550671a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c26652-5dae-47c0-854c-8b664d1ed653', 'volume_name': 'volume-39c26652-5dae-47c0-854c-8b664d1ed653', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33351d3f-c0d3-4b79-a67f-00a02bb1bfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33351d3f-c0d3-4b79-a67f-00a02bb1bfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa989e3-5991-4372-8156-cfaa3b5937f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:04 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Volume 39c26652-5dae-47c0-854c-8b664d1ed653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c26652-5dae-47c0-854c-8b664d1ed653', 'volume_size': 1} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-693436626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c26652-5dae-47c0-854c-8b664d1ed653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d7b467aa2845608c03b177ea2146d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:05Z,use_quota=True,user_id='a2f966221bfb4bf38dea506222cf5ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Creating volume 39c26652-5dae-47c0-854c-8b664d1ed653 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:11:04 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:11:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-39c26652-5dae-47c0-854c-8b664d1ed653 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:04 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-39c26652-5dae-47c0-854c-8b664d1ed653 1073741824 Jun 25 18:11:04 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7ca0a1d3-7d22-4c52-89c5-e133047c182f tempest-GroupsTest-471130289 None] Group tempest-Group2-598371697: creating Jun 25 18:11:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-fe0e97e7-a98b-4644-bab0-553dce15cecb tempest-GroupSnapshotsTest-215261498 None] group_snapshot f49c84f1-6bd7-4d69-9584-a9bff7978b84: deleted successfully Jun 25 18:11:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7ca0a1d3-7d22-4c52-89c5-e133047c182f tempest-GroupsTest-471130289 None] Group tempest-Group2-598371697: created successfully Jun 25 18:11:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7ca0a1d3-7d22-4c52-89c5-e133047c182f tempest-GroupsTest-471130289 None] Create group completed successfully. Jun 25 18:11:06 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-39c26652-5dae-47c0-854c-8b664d1ed653 1073741824" returned: 0 in 1.307s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-39c26652-5dae-47c0-854c-8b664d1ed653 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:06 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-39c26652-5dae-47c0-854c-8b664d1ed653 Jun 25 18:11:06 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "cinder-quobyte-b27bb511-80a5-4d90-b9ab-8a78d345cb4e" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-b27bb511-80a5-4d90-b9ab-8a78d345cb4e" acquired by "delete_volume" :: waited 0.069s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:06 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[047a11cd-3d1c-45c2-af08-3a2bd0108093]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Flow 'volume_create_manager' (5854b3d3-358b-49bc-b34f-11d60f07bfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd62c95f-4f6b-448f-8828-bb09c3dee0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd62c95f-4f6b-448f-8828-bb09c3dee0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-787623310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa9303e8-8386-4a68-a7c7-182bf5242f48,host='devstack@QuobyteHD#QuobyteHD',id=cb8c90e9-7d62-4c69-b8e9-fb4026293bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e888823ba33e40648029cb9d6316a136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:07Z,use_quota=True,user_id='279e4258d8764e9592f67084895c6e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e46897e-e2e8-4d2c-8c3b-e11acfa4642c),volume_type_id=2e46897e-e2e8-4d2c-8c3b-e11acfa4642c)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ac8298-6743-4357-b206-015a0856c143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ac8298-6743-4357-b206-015a0856c143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c5dc19-e83d-43ac-8a84-51929708e3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c5dc19-e83d-43ac-8a84-51929708e3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb8c90e9-7d62-4c69-b8e9-fb4026293bd5', 'volume_name': 'volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc0d1dd-9da4-492b-85d7-d03abac492db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc0d1dd-9da4-492b-85d7-d03abac492db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a57e1eb-8771-4c9e-b646-e7f4aa2e6654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:07 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Volume cb8c90e9-7d62-4c69-b8e9-fb4026293bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5', 'volume_size': 1} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:07 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e Jun 25 18:11:07 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:07 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-39c26652-5dae-47c0-854c-8b664d1ed653" returned: 0 in 1.536s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] <== create_volume: return (2914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.917s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.535s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa9303e8-8386-4a68-a7c7-182bf5242f48,created_at=2026-06-25T16:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-787623310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa9303e8-8386-4a68-a7c7-182bf5242f48,host='devstack@QuobyteHD#QuobyteHD',id=cb8c90e9-7d62-4c69-b8e9-fb4026293bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e888823ba33e40648029cb9d6316a136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:07Z,use_quota=True,user_id='279e4258d8764e9592f67084895c6e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e46897e-e2e8-4d2c-8c3b-e11acfa4642c),volume_type_id=2e46897e-e2e8-4d2c-8c3b-e11acfa4642c)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Creating volume cb8c90e9-7d62-4c69-b8e9-fb4026293bd5 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:11:07 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa989e3-5991-4372-8156-cfaa3b5937f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c26652-5dae-47c0-854c-8b664d1ed653', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b61559-fe3c-4400-bd5d-b4dd101c9c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:07 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5 1073741824 Jun 25 18:11:07 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:07 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Volume volume-39c26652-5dae-47c0-854c-8b664d1ed653 (39c26652-5dae-47c0-854c-8b664d1ed653): created successfully Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b61559-fe3c-4400-bd5d-b4dd101c9c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Flow 'volume_create_manager' (6665e52d-5c82-4b2f-b816-c29245ded924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:07 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-1a763d78-dc73-4838-aff5-7152fb79f9dc tempest-ServersNegativeTestJSON-1429313265 None] Created volume successfully. Jun 25 18:11:08 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e" returned: 0 in 1.367s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:08 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e Jun 25 18:11:08 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:08 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5 1073741824" returned: 0 in 1.092s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:08 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5 Jun 25 18:11:08 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:09 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b27bb511-80a5-4d90-b9ab-8a78d345cb4e" returned: 0 in 0.784s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Lock "cinder-quobyte-b27bb511-80a5-4d90-b9ab-8a78d345cb4e" released by "delete_volume" :: held 2.331s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:09 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Created reservations ['787b610a-1552-41f7-a13b-f9b592cab7db'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:09 devstack cinder-volume[93651]: WARNING cinder.quota [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1183641149 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1183641149, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:11:09 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Created reservations ['9eefa7a2-cf44-41d2-ab35-06ecaca38d8d', '46669fd9-95b1-47bc-825a-718fbb8ccc69', '581b3167-c7d6-40e8-a450-b4c0b5a08c25', '39e47b27-9f4d-4ae2-9e75-f85374f5228d'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:09 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:11:09 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Acquiring lock "cinder-39c26652-5dae-47c0-854c-8b664d1ed653-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Lock "cinder-39c26652-5dae-47c0-854c-8b664d1ed653-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Acquiring lock "cinder-quobyte-39c26652-5dae-47c0-854c-8b664d1ed653" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Lock "cinder-quobyte-39c26652-5dae-47c0-854c-8b664d1ed653" acquired by "delete_volume" :: waited 0.041s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[831380fe-79a5-4b62-b808-22d1c912bb27]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-39c26652-5dae-47c0-854c-8b664d1ed653 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:10 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5" returned: 0 in 1.683s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] <== create_volume: return (2834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.836s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:10 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-39c26652-5dae-47c0-854c-8b664d1ed653 Jun 25 18:11:10 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a57e1eb-8771-4c9e-b646-e7f4aa2e6654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf753b8-1a50-4312-aad7-5fdcfb3e4247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:10 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Volume volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5 (cb8c90e9-7d62-4c69-b8e9-fb4026293bd5): created successfully Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf753b8-1a50-4312-aad7-5fdcfb3e4247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Flow 'volume_create_manager' (5854b3d3-358b-49bc-b34f-11d60f07bfa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-5c5f5ba6-9b06-4509-b6c9-9569c07b5068 tempest-GroupsTest-471130289 None] Created volume successfully. Jun 25 18:11:10 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.295s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:10 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-a83426b1-be26-41f8-a29b-78de1619d208 tempest-GroupSnapshotsTest-215261498 None] Delete group completed successfully. Jun 25 18:11:11 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-39c26652-5dae-47c0-854c-8b664d1ed653" returned: 0 in 1.426s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-39c26652-5dae-47c0-854c-8b664d1ed653 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:11 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-39c26652-5dae-47c0-854c-8b664d1ed653 Jun 25 18:11:11 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:12 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Acquiring lock "cinder-quobyte-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:12 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Lock "cinder-quobyte-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5" acquired by "delete_volume" :: waited 0.031s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:12 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8e913c-18cc-4864-b174-c7bddee4cf62]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:12 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5 Jun 25 18:11:12 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:13 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-39c26652-5dae-47c0-854c-8b664d1ed653" returned: 0 in 1.272s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Lock "cinder-quobyte-39c26652-5dae-47c0-854c-8b664d1ed653" released by "delete_volume" :: held 2.815s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:13 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Created reservations ['7d58e978-07aa-45f5-89f0-8445964982ce', '3b8f8e54-629f-477d-81c8-540b6bae013a', 'c2b35e60-4eeb-4148-9515-d9232717e0af', '193fb4bc-59da-4f17-90e2-1fc936d9fa9f'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:13 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:11:13 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Acquiring lock "cinder-11a2f678-6f43-4532-8acf-818cca2989c4-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Lock "cinder-11a2f678-6f43-4532-8acf-818cca2989c4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Acquiring lock "cinder-quobyte-11a2f678-6f43-4532-8acf-818cca2989c4" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Lock "cinder-quobyte-11a2f678-6f43-4532-8acf-818cca2989c4" acquired by "delete_volume" :: waited 0.059s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:14 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[42df061b-865c-413c-b298-08dbb58d7536]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11a2f678-6f43-4532-8acf-818cca2989c4 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:14 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11a2f678-6f43-4532-8acf-818cca2989c4 Jun 25 18:11:14 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:14 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5" returned: 0 in 1.934s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:14 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5 Jun 25 18:11:14 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:14 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.349s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:14 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:14 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Deleted volume successfully. Jun 25 18:11:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-de629311-d404-4fff-b600-8cc5bb963795 tempest-ServersNegativeTestJSON-1429313265 None] Lock "cinder-39c26652-5dae-47c0-854c-8b664d1ed653-delete_volume" released by "delete_volume" :: held 4.602s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:15 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11a2f678-6f43-4532-8acf-818cca2989c4" returned: 0 in 1.649s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11a2f678-6f43-4532-8acf-818cca2989c4 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:15 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11a2f678-6f43-4532-8acf-818cca2989c4 Jun 25 18:11:15 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:15 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5" returned: 0 in 1.395s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Lock "cinder-quobyte-cb8c90e9-7d62-4c69-b8e9-fb4026293bd5" released by "delete_volume" :: held 3.385s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:16 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Created reservations ['946b1d27-1af4-4b75-803c-30b5655bce0d'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:16 devstack cinder-volume[93651]: WARNING cinder.quota [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-531227295 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-531227295, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:11:16 devstack cinder-volume[93651]: WARNING cinder.quota [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-531227295 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-531227295, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:11:16 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Created reservations ['189b869a-7368-4f81-b598-8fe69ba21a34', 'bce1e6cf-7db5-4be6-80d1-a52d99649eb9', '2067d18d-6f56-43d6-8e68-0d3664825044', 'a18bb35c-5ced-4fc8-add3-13b07abbce4c'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:16 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:11:16 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:16 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-f8bbb0cd-705f-43dd-b7e2-1abec9222c56 tempest-GroupsTest-471130289 None] Created reservations ['55d3a5ea-ce73-45cd-a706-0bc6f73c5447'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f8bbb0cd-705f-43dd-b7e2-1abec9222c56 tempest-GroupsTest-471130289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f8bbb0cd-705f-43dd-b7e2-1abec9222c56 tempest-GroupsTest-471130289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f8bbb0cd-705f-43dd-b7e2-1abec9222c56 tempest-GroupsTest-471130289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f8bbb0cd-705f-43dd-b7e2-1abec9222c56 tempest-GroupsTest-471130289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f8bbb0cd-705f-43dd-b7e2-1abec9222c56 tempest-GroupsTest-471130289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f8bbb0cd-705f-43dd-b7e2-1abec9222c56 tempest-GroupsTest-471130289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:17 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:11:17 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:17 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11a2f678-6f43-4532-8acf-818cca2989c4" returned: 0 in 1.451s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Lock "cinder-quobyte-11a2f678-6f43-4532-8acf-818cca2989c4" released by "delete_volume" :: held 3.186s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:17 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Created reservations ['f870533c-fcf4-4496-951e-42d4c9c85139', '3dafc0d4-f2e5-4585-ad6a-1436f05085b4', '0d60e8e7-87c0-4dc1-9869-4a418f2bd086', '55a3f689-b97d-46e9-ae0e-92ef44fd0bc9'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:17 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.199s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:17 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:17 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-701c0a18-1ef9-4a3e-9679-79b596140a57 tempest-GroupsTest-471130289 None] Delete group completed successfully. Jun 25 18:11:17 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:11:17 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:18 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f8bbb0cd-705f-43dd-b7e2-1abec9222c56 tempest-GroupsTest-471130289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.274s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:18 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-f8bbb0cd-705f-43dd-b7e2-1abec9222c56 tempest-GroupsTest-471130289 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:18 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f8bbb0cd-705f-43dd-b7e2-1abec9222c56 tempest-GroupsTest-471130289 None] Delete group completed successfully. Jun 25 18:11:18 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.276s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:18 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:18 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Deleted volume successfully. Jun 25 18:11:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b2155da8-0cdb-4fc4-9a73-313735b4416a tempest-ServersNegativeTestJSON-1429313265 None] Lock "cinder-11a2f678-6f43-4532-8acf-818cca2989c4-delete_volume" released by "delete_volume" :: held 4.962s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:19 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d0d660d8-c207-4182-b762-e1657b777329 tempest-GroupsTest-471130289 None] Group tempest-GroupsTest-Group-1245955973: creating Jun 25 18:11:19 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d0d660d8-c207-4182-b762-e1657b777329 tempest-GroupsTest-471130289 None] Group tempest-GroupsTest-Group-1245955973: created successfully Jun 25 18:11:19 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d0d660d8-c207-4182-b762-e1657b777329 tempest-GroupsTest-471130289 None] Create group completed successfully. Jun 25 18:11:19 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-bcde0fc0-6bd6-42a4-9e75-ef9a758faeb3 tempest-GroupsV314Test-2065765571 None] Group tempest-GroupsV314Test-Group-162872322: creating Jun 25 18:11:19 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-bcde0fc0-6bd6-42a4-9e75-ef9a758faeb3 tempest-GroupsV314Test-2065765571 None] Group tempest-GroupsV314Test-Group-162872322: created successfully Jun 25 18:11:19 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-bcde0fc0-6bd6-42a4-9e75-ef9a758faeb3 tempest-GroupsV314Test-2065765571 None] Create group completed successfully. Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Flow 'volume_create_manager' (77107af8-3b52-48f7-a56c-5ec035d2ddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734b6889-7c45-4448-ac51-818e7191bc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734b6889-7c45-4448-ac51-818e7191bc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-287355478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c88c3a6a-1ae2-4419-a6b2-ea1d4159b3f5,host='devstack@QuobyteHD#QuobyteHD',id=a4a13a9e-1d2a-4fe1-85dd-fc320464fe30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e888823ba33e40648029cb9d6316a136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:21Z,use_quota=True,user_id='279e4258d8764e9592f67084895c6e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca596a74-dcd2-4720-8d12-858316d1aa18),volume_type_id=ca596a74-dcd2-4720-8d12-858316d1aa18)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5304804-a8b3-46a8-b3ff-3e5a6fab9ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5304804-a8b3-46a8-b3ff-3e5a6fab9ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a60b03-4d25-4980-aa86-6a179ea7d562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a60b03-4d25-4980-aa86-6a179ea7d562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a13a9e-1d2a-4fe1-85dd-fc320464fe30', 'volume_name': 'volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f0e60a-bc5f-4a3f-9172-fd37a79d23b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f0e60a-bc5f-4a3f-9172-fd37a79d23b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce914279-8a4c-4361-b29d-c01e90379717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:21 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Volume a4a13a9e-1d2a-4fe1-85dd-fc320464fe30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30', 'volume_size': 1} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c88c3a6a-1ae2-4419-a6b2-ea1d4159b3f5,created_at=2026-06-25T16:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-287355478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c88c3a6a-1ae2-4419-a6b2-ea1d4159b3f5,host='devstack@QuobyteHD#QuobyteHD',id=a4a13a9e-1d2a-4fe1-85dd-fc320464fe30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e888823ba33e40648029cb9d6316a136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:21Z,use_quota=True,user_id='279e4258d8764e9592f67084895c6e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca596a74-dcd2-4720-8d12-858316d1aa18),volume_type_id=ca596a74-dcd2-4720-8d12-858316d1aa18)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Creating volume a4a13a9e-1d2a-4fe1-85dd-fc320464fe30 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:11:21 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:21 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30 1073741824 Jun 25 18:11:21 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Flow 'volume_create_manager' (b6d78c25-3185-4506-a86d-2c4c08b4fe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6015d6ce-7963-4094-a8c2-29ad681bd159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6015d6ce-7963-4094-a8c2-29ad681bd159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1350501267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4de2276d-eaa2-43d4-8b16-227dc770feb0,host='devstack@QuobyteHD#QuobyteHD',id=ad484a99-439c-4d25-9e8f-3bf9a058f933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b678fd40a64cdb998ee30ca638f0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:22Z,use_quota=True,user_id='e60333287217437c85ba278a04ed3207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(396f4125-8618-40a2-b213-01e73099cd37),volume_type_id=396f4125-8618-40a2-b213-01e73099cd37)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac742db-5992-4c3f-8c3d-f9f26b25d6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac742db-5992-4c3f-8c3d-f9f26b25d6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6dd574a-d179-4922-bace-e03865599ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6dd574a-d179-4922-bace-e03865599ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad484a99-439c-4d25-9e8f-3bf9a058f933', 'volume_name': 'volume-ad484a99-439c-4d25-9e8f-3bf9a058f933', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730026b6-d778-41e1-a8b8-e7cf2782ac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730026b6-d778-41e1-a8b8-e7cf2782ac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a181d7a-e48b-4671-af26-14b0852c9157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:21 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Volume ad484a99-439c-4d25-9e8f-3bf9a058f933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad484a99-439c-4d25-9e8f-3bf9a058f933', 'volume_size': 1} Jun 25 18:11:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:22 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30 1073741824" returned: 0 in 0.985s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:22 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30 Jun 25 18:11:22 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:23 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30" returned: 0 in 0.654s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.483s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4de2276d-eaa2-43d4-8b16-227dc770feb0,created_at=2026-06-25T16:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1350501267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4de2276d-eaa2-43d4-8b16-227dc770feb0,host='devstack@QuobyteHD#QuobyteHD',id=ad484a99-439c-4d25-9e8f-3bf9a058f933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b678fd40a64cdb998ee30ca638f0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:22Z,use_quota=True,user_id='e60333287217437c85ba278a04ed3207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(396f4125-8618-40a2-b213-01e73099cd37),volume_type_id=396f4125-8618-40a2-b213-01e73099cd37)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Creating volume ad484a99-439c-4d25-9e8f-3bf9a058f933 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:11:23 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce914279-8a4c-4361-b29d-c01e90379717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4f6f88-69da-4dc4-9114-6db360db526b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:23 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 1073741824 Jun 25 18:11:23 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:23 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Volume volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30 (a4a13a9e-1d2a-4fe1-85dd-fc320464fe30): created successfully Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4f6f88-69da-4dc4-9114-6db360db526b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Flow 'volume_create_manager' (77107af8-3b52-48f7-a56c-5ec035d2ddee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:23 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6fd65636-e494-4aaa-8ab5-d048b1499441 tempest-GroupsTest-471130289 None] Created volume successfully. Jun 25 18:11:24 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 1073741824" returned: 0 in 1.060s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:24 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 Jun 25 18:11:24 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:24 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:11:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Flow 'volume_create_manager' (2e41540a-b935-42c7-89ab-5b659ab21caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0172a53-587f-4126-bb82-a0fcfdfe7427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0172a53-587f-4126-bb82-a0fcfdfe7427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-186178084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c88c3a6a-1ae2-4419-a6b2-ea1d4159b3f5,host='devstack@QuobyteHD#QuobyteHD',id=9910e5c5-8d8f-48e2-b09e-54521d5b6a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e888823ba33e40648029cb9d6316a136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:25Z,use_quota=True,user_id='279e4258d8764e9592f67084895c6e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca596a74-dcd2-4720-8d12-858316d1aa18),volume_type_id=ca596a74-dcd2-4720-8d12-858316d1aa18)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf91410f-2471-4d4f-8686-a77d936fb8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf91410f-2471-4d4f-8686-a77d936fb8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2ee675-d259-4266-ab23-c4486cc67056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2ee675-d259-4266-ab23-c4486cc67056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9910e5c5-8d8f-48e2-b09e-54521d5b6a80', 'volume_name': 'volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c311ee-51ff-4abe-8073-7d22026af4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c311ee-51ff-4abe-8073-7d22026af4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670d2e09-4397-4de1-9279-aa1d1b6452ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:24 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Volume 9910e5c5-8d8f-48e2-b09e-54521d5b6a80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80', 'volume_size': 1} Jun 25 18:11:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:25 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933" returned: 0 in 0.793s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c88c3a6a-1ae2-4419-a6b2-ea1d4159b3f5,created_at=2026-06-25T16:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-186178084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c88c3a6a-1ae2-4419-a6b2-ea1d4159b3f5,host='devstack@QuobyteHD#QuobyteHD',id=9910e5c5-8d8f-48e2-b09e-54521d5b6a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e888823ba33e40648029cb9d6316a136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:25Z,use_quota=True,user_id='279e4258d8764e9592f67084895c6e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca596a74-dcd2-4720-8d12-858316d1aa18),volume_type_id=ca596a74-dcd2-4720-8d12-858316d1aa18)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Creating volume 9910e5c5-8d8f-48e2-b09e-54521d5b6a80 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:11:25 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:25 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80 1073741824 Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a181d7a-e48b-4671-af26-14b0852c9157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad484a99-439c-4d25-9e8f-3bf9a058f933', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:25 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74eccb69-f47e-41e9-a2fc-a3f670e4e68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:25 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Volume volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 (ad484a99-439c-4d25-9e8f-3bf9a058f933): created successfully Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74eccb69-f47e-41e9-a2fc-a3f670e4e68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Flow 'volume_create_manager' (b6d78c25-3185-4506-a86d-2c4c08b4fe5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:25 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-62450af7-cee1-4106-a731-b987c4d5e733 tempest-GroupsV314Test-2065765571 None] Created volume successfully. Jun 25 18:11:26 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80 1073741824" returned: 0 in 0.912s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:26 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80 Jun 25 18:11:26 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:27 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80" returned: 0 in 0.824s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:11:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670d2e09-4397-4de1-9279-aa1d1b6452ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a856c3-99f3-4022-882e-3f55598966a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:27 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Volume volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80 (9910e5c5-8d8f-48e2-b09e-54521d5b6a80): created successfully Jun 25 18:11:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a856c3-99f3-4022-882e-3f55598966a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Flow 'volume_create_manager' (2e41540a-b935-42c7-89ab-5b659ab21caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:27 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6eec497b-c18f-4f4f-a81b-70b006b4688c tempest-GroupsTest-471130289 None] Created volume successfully. Jun 25 18:11:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:27 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Cloning volume ad484a99-439c-4d25-9e8f-3bf9a058f933 to volume d36da8f9-e848-49af-9da6-47f5ef980cf9 Jun 25 18:11:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Creating offline snapshot 6f870613-dd73-44a8-ba45-bdff361d786c of volume ad484a99-439c-4d25-9e8f-3bf9a058f933 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:11:27 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a8981a-b421-426c-b45b-27d14865272b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:27 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 Jun 25 18:11:28 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:28 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-8b71fd45-2ce0-421c-855e-21cc18c4b842 tempest-GroupsTest-471130289 None] Update group completed successfully. Jun 25 18:11:28 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933" returned: 0 in 0.947s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:28 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c 1G Jun 25 18:11:28 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:30 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c 1G" returned: 0 in 1.273s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:30 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c Jun 25 18:11:30 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:30 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d08aaf30-a0c9-4589-8e6c-7904e685f1e5 tempest-GroupsTest-471130289 None] Update group completed successfully. Jun 25 18:11:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c" returned: 0 in 1.171s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:31 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:11:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:31 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:31 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c Jun 25 18:11:31 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Acquiring lock "cinder-quobyte-9910e5c5-8d8f-48e2-b09e-54521d5b6a80" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Lock "cinder-quobyte-9910e5c5-8d8f-48e2-b09e-54521d5b6a80" acquired by "delete_volume" :: waited 0.030s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:32 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd11772-2c7e-4af7-ae9f-9c45a01cad53]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:32 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c" returned: 0 in 1.315s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:32 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80 Jun 25 18:11:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:32 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:32 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.info Jun 25 18:11:32 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:33 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80" returned: 0 in 0.959s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:33 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80 Jun 25 18:11:33 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:33 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.info" returned: 0 in 0.867s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:33 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:11:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:33 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.info Jun 25 18:11:33 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:34 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.info" returned: 0 in 0.927s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:34 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Acquiring lock "cinder-quobyte-d36da8f9-e848-49af-9da6-47f5ef980cf9" by "_copy_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9910e5c5-8d8f-48e2-b09e-54521d5b6a80" returned: 0 in 1.026s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Lock "cinder-quobyte-d36da8f9-e848-49af-9da6-47f5ef980cf9" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] snapshot: 6f870613-dd73-44a8-ba45-bdff361d786c, volume: d36da8f9-e848-49af-9da6-47f5ef980cf9, {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Lock "cinder-quobyte-9910e5c5-8d8f-48e2-b09e-54521d5b6a80" released by "delete_volume" :: held 2.116s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Acquiring lock "cinder-quobyte-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d187eb-2a2f-4d39-8113-36a4ece5a69c]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Lock "cinder-quobyte-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30" acquired by "delete_volume" :: waited 0.050s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Flow 'volume_create_manager' (e060f0c3-588f-47ae-927f-e5be2d00c475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc6ba3e-44b0-42d5-ab7c-5269d29b6177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[a883d715-1283-4896-b519-16929170b822]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:34 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c Jun 25 18:11:34 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc6ba3e-44b0-42d5-ab7c-5269d29b6177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-679035798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf703cf-a76e-4c02-ba2d-5ba5c3f48f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e4d327116441b7a53975dd0fbc05d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:35Z,use_quota=True,user_id='5bd08726b0ec43aa9cee47131561485c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963c26b6-4cb9-4e9e-8fa1-f87f7bc4e279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963c26b6-4cb9-4e9e-8fa1-f87f7bc4e279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16552f95-bf9e-4680-972e-4e1537cf03b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16552f95-bf9e-4680-972e-4e1537cf03b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf703cf-a76e-4c02-ba2d-5ba5c3f48f43', 'volume_name': 'volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d3a6d5-a774-4aff-8fd2-6085f6027243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d3a6d5-a774-4aff-8fd2-6085f6027243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cda337-0062-4ca2-880a-808648e276f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:34 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Volume faf703cf-a76e-4c02-ba2d-5ba5c3f48f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43', 'volume_size': 1} Jun 25 18:11:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:34 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30 Jun 25 18:11:34 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:35 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c" returned: 0 in 1.065s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad484a99-439c-4d25-9e8f-3bf9a058f933(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:11:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] will copy from snapshot at /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:11:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Creating direct copy from snapshot {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:11:35 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[a921b9d0-c272-450c-84e6-eb633d0ba972]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:35 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 Jun 25 18:11:35 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:35 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30" returned: 0 in 1.173s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:35 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30 Jun 25 18:11:35 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:36 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30" returned: 0 in 0.831s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Lock "cinder-quobyte-a4a13a9e-1d2a-4fe1-85dd-fc320464fe30" released by "delete_volume" :: held 2.109s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:36 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933" returned: 0 in 1.102s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:36 devstack cinder-volume[93651]: DEBUG cinder.utils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Path /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9 not found in is_blk_device check {{(pid=93651) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:11:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:36 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9 Jun 25 18:11:36 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:36 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Created reservations ['8076e8d1-67fe-4163-bc54-61891ec72b0e'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:36 devstack cinder-volume[93651]: WARNING cinder.quota [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-28160837 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-28160837, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:11:36 devstack cinder-volume[93651]: WARNING cinder.quota [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-28160837 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-28160837, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:11:36 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Created reservations ['0b581955-da16-4ea6-85fa-a2ad12297620', '2bc62e1b-5f15-45b0-91df-860450b492ab', '4ec73a56-6f5a-456a-8214-92cbf647c975', '0452bf2f-87ab-4045-918a-94ef1617bdd3'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:37 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Created reservations ['91da664f-4fe6-4cea-80bc-40d82de2992e', '67dee0b7-bf96-4537-8080-823416a77a0e', '578f940d-a96c-44ce-b91e-71fbe0544ad0', '777c8487-5a4a-4096-918a-985cbd97d311'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:37 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:11:37 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:38 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.313s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:38 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:38 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-21e39d45-3a28-48d5-89ca-d87708886c35 tempest-GroupsTest-471130289 None] Delete group completed successfully. Jun 25 18:11:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:11:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:39 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:11:39 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:41 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 2.261s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:41 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:41 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:11:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 8 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:11:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:11:43 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9" returned: 0 in 7.102s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:43 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6ee48d-bbed-4966-abdb-24b1cb123e5c]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:44 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 Jun 25 18:11:44 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:45 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933" returned: 0 in 1.370s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:45 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Image conversion details: src /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:11:45 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Converted 1024.00 MB image at 144.12 MB/s Jun 25 18:11:45 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9 is being set with open permissions: ugo+rw: NotImplementedError Jun 25 18:11:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:45 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9 Jun 25 18:11:45 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:46 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9" returned: 0 in 0.718s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:46 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Lock "cinder-quobyte-d36da8f9-e848-49af-9da6-47f5ef980cf9" released by "_copy_volume_from_snapshot" :: held 11.496s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:46 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=111,cinder:INSERT=29,cinder:UPDATE=136,cinder:DELETE=4 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:11:46 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Acquiring lock "cinder-quobyte-6f870613-dd73-44a8-ba45-bdff361d786c" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:46 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Lock "cinder-quobyte-6f870613-dd73-44a8-ba45-bdff361d786c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Deleting offline snapshot 6f870613-dd73-44a8-ba45-bdff361d786c of volume ad484a99-439c-4d25-9e8f-3bf9a058f933 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:11:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] snapshot_file for this snap is: volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:11:46 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1739415-72a3-49e5-a4d9-1650714e1c6b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:46 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c Jun 25 18:11:46 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:47 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c" returned: 0 in 1.076s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad484a99-439c-4d25-9e8f-3bf9a058f933(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:11:47 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=118,cinder:INSERT=31,cinder:UPDATE=126,cinder:DELETE=5 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:11:47 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9adc1e0-0041-453b-a553-79b9388596a2]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:47 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 Jun 25 18:11:47 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:48 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:11:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Flow 'volume_create_manager' (caf6871a-2fb5-4899-a668-6cc8933d2699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c4ca23-e34e-44fe-8f70-54fb1de5a0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c4ca23-e34e-44fe-8f70-54fb1de5a0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1249251543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1107e10a-bf52-4b70-9e0b-866161350e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdcea62e75d4b7a901e096a829275dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:48Z,use_quota=True,user_id='7fe745d1bdb54ceca516c9e8a67c012d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8830a2e-94aa-443d-8ff9-cd2ab7d11be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8830a2e-94aa-443d-8ff9-cd2ab7d11be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad6b558-c221-48ab-9012-5e878237df85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad6b558-c221-48ab-9012-5e878237df85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1107e10a-bf52-4b70-9e0b-866161350e74', 'volume_name': 'volume-1107e10a-bf52-4b70-9e0b-866161350e74', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3996a1-3531-45f8-b5a4-b8cc5e937b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3996a1-3531-45f8-b5a4-b8cc5e937b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ace9244-499e-4cc0-bef3-a3a5538605c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:48 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Volume 1107e10a-bf52-4b70-9e0b-866161350e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1107e10a-bf52-4b70-9e0b-866161350e74', 'volume_size': 1} Jun 25 18:11:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:48 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933" returned: 0 in 1.180s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:48 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c Jun 25 18:11:48 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:49 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c" returned: 0 in 0.872s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:49 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c Jun 25 18:11:49 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:50 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933.6f870613-dd73-44a8-ba45-bdff361d786c" returned: 0 in 0.734s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Lock "cinder-quobyte-6f870613-dd73-44a8-ba45-bdff361d786c" released by "_delete_snapshot" :: held 4.025s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.388s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.331s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-679035798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf703cf-a76e-4c02-ba2d-5ba5c3f48f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e4d327116441b7a53975dd0fbc05d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:35Z,use_quota=True,user_id='5bd08726b0ec43aa9cee47131561485c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:11:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Creating volume faf703cf-a76e-4c02-ba2d-5ba5c3f48f43 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:11:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:11:50 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:11:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:50 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43 1073741824 Jun 25 18:11:50 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:50 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-cd4c1ce9-d7c4-44fb-8e4f-291edb2fde4f tempest-GroupsV314Test-2065765571 None] Create group from source-group-4de2276d-eaa2-43d4-8b16-227dc770feb0 completed successfully. Jun 25 18:11:51 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43 1073741824" returned: 0 in 1.206s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:51 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43 Jun 25 18:11:51 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Acquiring lock "cinder-quobyte-d36da8f9-e848-49af-9da6-47f5ef980cf9" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Lock "cinder-quobyte-d36da8f9-e848-49af-9da6-47f5ef980cf9" acquired by "delete_volume" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[17157ba8-11a1-4fd4-a0b8-c99023c40335]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:52 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9 Jun 25 18:11:52 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:52 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43" returned: 0 in 0.790s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.975s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1249251543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1107e10a-bf52-4b70-9e0b-866161350e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdcea62e75d4b7a901e096a829275dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:11:48Z,use_quota=True,user_id='7fe745d1bdb54ceca516c9e8a67c012d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Creating volume 1107e10a-bf52-4b70-9e0b-866161350e74 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:11:52 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:52 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74 1073741824 Jun 25 18:11:52 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cda337-0062-4ca2-880a-808648e276f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88911b9-1c6a-4bcd-8bad-af66fde75ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:52 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Volume volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43 (faf703cf-a76e-4c02-ba2d-5ba5c3f48f43): created successfully Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88911b9-1c6a-4bcd-8bad-af66fde75ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Flow 'volume_create_manager' (e060f0c3-588f-47ae-927f-e5be2d00c475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:52 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7b483e48-c8f9-4675-bc8d-1a1413798e2a tempest-AttachVolumeNegativeTest-510956435 None] Created volume successfully. Jun 25 18:11:53 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9" returned: 0 in 1.038s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:53 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9 Jun 25 18:11:53 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:53 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74 1073741824" returned: 0 in 1.194s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:53 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74 Jun 25 18:11:53 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:53 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d36da8f9-e848-49af-9da6-47f5ef980cf9" returned: 0 in 0.884s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Lock "cinder-quobyte-d36da8f9-e848-49af-9da6-47f5ef980cf9" released by "delete_volume" :: held 1.967s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Created reservations ['9837eb86-e7ab-4567-af30-8ad88955b49c'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:54 devstack cinder-volume[93651]: WARNING cinder.quota [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-732814310 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-732814310, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:11:54 devstack cinder-volume[93651]: WARNING cinder.quota [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-732814310 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-732814310, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Created reservations ['40931568-e216-4259-9be5-7c0da5b851c0', '3fdee671-e6a3-4591-8752-9e1c0cf1948f', 'bcf48641-6d9d-477c-85e5-4522734a475a', '61526bf3-8ae4-4928-bbfa-4d2cef972f12'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:54 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:11:54 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:54 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74" returned: 0 in 0.846s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ace9244-499e-4cc0-bef3-a3a5538605c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1107e10a-bf52-4b70-9e0b-866161350e74', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52990a97-683d-431b-bf7d-8366308ec94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:11:54 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Volume volume-1107e10a-bf52-4b70-9e0b-866161350e74 (1107e10a-bf52-4b70-9e0b-866161350e74): created successfully Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52990a97-683d-431b-bf7d-8366308ec94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Flow 'volume_create_manager' (caf6871a-2fb5-4899-a668-6cc8933d2699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:11:54 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-a4bb58c9-33e7-4327-8c30-43a5c6526277 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Created volume successfully. Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Acquiring lock "cinder-quobyte-ad484a99-439c-4d25-9e8f-3bf9a058f933" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Lock "cinder-quobyte-ad484a99-439c-4d25-9e8f-3bf9a058f933" acquired by "delete_volume" :: waited 0.036s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6606c4-d066-4bc0-bde4-089a78f9eacd]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:55 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.816s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:55 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:55 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-095ef2ea-aaa9-4ca0-9a13-56e4a5ddb589 tempest-GroupsV314Test-2065765571 None] Delete group completed successfully. Jun 25 18:11:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Creating offline snapshot 9f04a965-c547-4743-bcdf-4fc8e30c7473 of volume 1107e10a-bf52-4b70-9e0b-866161350e74 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:11:55 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca4b617-4b74-4f71-ba6c-2926e63b5fa5]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:11:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:55 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 Jun 25 18:11:55 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:55 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74 Jun 25 18:11:55 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:55 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933" returned: 0 in 0.939s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:55 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933 Jun 25 18:11:55 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-aa407f36-cce2-4f09-a254-1a6a35fe8c16 req-63ccd972-78f6-46ce-b2be-07ce23e249bf tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:56 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74" returned: 0 in 1.116s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:56 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 1G Jun 25 18:11:56 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:56 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad484a99-439c-4d25-9e8f-3bf9a058f933" returned: 0 in 1.010s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:56 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Lock "cinder-quobyte-ad484a99-439c-4d25-9e8f-3bf9a058f933" released by "delete_volume" :: held 2.104s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:11:57 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Created reservations ['77166fee-c431-409e-8a06-2fba613254a8'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:57 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Created reservations ['08fe9ecc-f284-4981-812a-6c4c8e96af1f', 'dca3482a-f097-4a88-bb5d-7b957070495a', '3ed1bf44-0f0a-4616-b7bb-c6aabafe6e44', '08130eac-4aa5-4c2d-ae80-b66e51c4177e'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:11:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:11:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:11:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:11:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:11:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:11:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:57 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:11:57 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:57 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 1G" returned: 0 in 1.086s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1107e10a-bf52-4b70-9e0b-866161350e74 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:57 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1107e10a-bf52-4b70-9e0b-866161350e74 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 Jun 25 18:11:57 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:58 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.861s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:58 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:11:58 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4676d1eb-11e5-4dfe-ac08-c0b0cf26bb27 tempest-GroupsV314Test-2065765571 None] Delete group completed successfully. Jun 25 18:11:58 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1107e10a-bf52-4b70-9e0b-866161350e74 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473" returned: 0 in 0.918s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:58 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 is being set with open permissions: ugo+rw Jun 25 18:11:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:58 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 Jun 25 18:11:58 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:59 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473" returned: 0 in 0.779s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:59 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.info Jun 25 18:11:59 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:11:59 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jun 25 18:11:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.info" returned: 0 in 0.757s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:11:59 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.info is being set with open permissions: ugo+rw Jun 25 18:11:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:11:59 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.info Jun 25 18:11:59 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:00 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.info" returned: 0 in 0.734s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.526s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-aa407f36-cce2-4f09-a254-1a6a35fe8c16 req-63ccd972-78f6-46ce-b2be-07ce23e249bf tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.389s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:00 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1ed0f6-0ec1-454f-b311-6803591fb24f]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-aa407f36-cce2-4f09-a254-1a6a35fe8c16 req-63ccd972-78f6-46ce-b2be-07ce23e249bf tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:00 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f1f578ac-af66-4a0d-9b6e-1096105eb56a tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Create snapshot completed successfully Jun 25 18:12:00 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43 Jun 25 18:12:00 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:01 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-aa407f36-cce2-4f09-a254-1a6a35fe8c16 req-63ccd972-78f6-46ce-b2be-07ce23e249bf tempest-AttachVolumeNegativeTest-510956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43" returned: 0 in 1.035s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-aa407f36-cce2-4f09-a254-1a6a35fe8c16 req-63ccd972-78f6-46ce-b2be-07ce23e249bf tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.059s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-aa407f36-cce2-4f09-a254-1a6a35fe8c16 req-63ccd972-78f6-46ce-b2be-07ce23e249bf tempest-AttachVolumeNegativeTest-510956435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '779259da-c68b-4760-bcfc-302f0bed57f2', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:12:01 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-aa407f36-cce2-4f09-a254-1a6a35fe8c16 req-63ccd972-78f6-46ce-b2be-07ce23e249bf tempest-AttachVolumeNegativeTest-510956435 None] attachment_update completed successfully. Jun 25 18:12:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Acquiring lock "cinder-9f04a965-c547-4743-bcdf-4fc8e30c7473-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "cinder-9f04a965-c547-4743-bcdf-4fc8e30c7473-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Acquiring lock "cinder-quobyte-1107e10a-bf52-4b70-9e0b-866161350e74" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "cinder-quobyte-1107e10a-bf52-4b70-9e0b-866161350e74" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Acquiring lock "cinder-quobyte-9f04a965-c547-4743-bcdf-4fc8e30c7473" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "cinder-quobyte-9f04a965-c547-4743-bcdf-4fc8e30c7473" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Deleting offline snapshot 9f04a965-c547-4743-bcdf-4fc8e30c7473 of volume 1107e10a-bf52-4b70-9e0b-866161350e74 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:12:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] snapshot_file for this snap is: volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:12:02 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae8fa10-56fb-4b32-ae77-182134b1e8e9]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:02 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 Jun 25 18:12:02 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:03 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473" returned: 0 in 1.166s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1107e10a-bf52-4b70-9e0b-866161350e74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:12:03 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[331aba99-ab96-40c9-b97b-154ff3030640]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:03 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74 Jun 25 18:12:03 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-00a38fd1-f6f9-4db0-9512-ab376e0cbce1 tempest-GroupsV320Test-1831568166 None] Group tempest-GroupsV320Test-Group-163592993: creating Jun 25 18:12:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-00a38fd1-f6f9-4db0-9512-ab376e0cbce1 tempest-GroupsV320Test-1831568166 None] Group tempest-GroupsV320Test-Group-163592993: created successfully Jun 25 18:12:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-00a38fd1-f6f9-4db0-9512-ab376e0cbce1 tempest-GroupsV320Test-1831568166 None] Create group completed successfully. Jun 25 18:12:04 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74" returned: 0 in 1.059s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:04 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 Jun 25 18:12:04 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:05 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473" returned: 0 in 0.796s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:05 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473 Jun 25 18:12:05 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:06 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-e38eb03e-0feb-4f11-9b51-3ab4831995a4 tempest-GroupsV320Test-1831568166 None] Created reservations ['e735aef4-7dd8-4ee3-bcfd-cdb6d187ec3d'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:12:06 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74.9f04a965-c547-4743-bcdf-4fc8e30c7473" returned: 0 in 0.798s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "cinder-quobyte-9f04a965-c547-4743-bcdf-4fc8e30c7473" released by "_delete_snapshot" :: held 4.076s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e38eb03e-0feb-4f11-9b51-3ab4831995a4 tempest-GroupsV320Test-1831568166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e38eb03e-0feb-4f11-9b51-3ab4831995a4 tempest-GroupsV320Test-1831568166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e38eb03e-0feb-4f11-9b51-3ab4831995a4 tempest-GroupsV320Test-1831568166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e38eb03e-0feb-4f11-9b51-3ab4831995a4 tempest-GroupsV320Test-1831568166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e38eb03e-0feb-4f11-9b51-3ab4831995a4 tempest-GroupsV320Test-1831568166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e38eb03e-0feb-4f11-9b51-3ab4831995a4 tempest-GroupsV320Test-1831568166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "cinder-quobyte-1107e10a-bf52-4b70-9e0b-866161350e74" released by "delete_snapshot" :: held 4.146s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:06 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:12:06 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:06 devstack cinder-volume[93651]: WARNING cinder.quota [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:12:06 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Created reservations ['0f918224-4b64-45ef-b13a-4fbbe87f6d12', 'a053da4e-5805-4003-b115-c63767ebf311', '9e81349b-8101-4c66-9e0d-0b476ea12beb', 'c4da117c-231d-4909-bdf9-c917a633fc4f'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:12:06 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Delete snapshot completed successfully. Jun 25 18:12:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cb42ba1-7f85-4849-a989-afe043b85d9c tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "cinder-9f04a965-c547-4743-bcdf-4fc8e30c7473-delete_snapshot" released by "delete_snapshot" :: held 4.508s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:07 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e38eb03e-0feb-4f11-9b51-3ab4831995a4 tempest-GroupsV320Test-1831568166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.778s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:07 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-e38eb03e-0feb-4f11-9b51-3ab4831995a4 tempest-GroupsV320Test-1831568166 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:12:07 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e38eb03e-0feb-4f11-9b51-3ab4831995a4 tempest-GroupsV320Test-1831568166 None] Delete group completed successfully. Jun 25 18:12:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Acquiring lock "cinder-1107e10a-bf52-4b70-9e0b-866161350e74-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "cinder-1107e10a-bf52-4b70-9e0b-866161350e74-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Acquiring lock "cinder-quobyte-1107e10a-bf52-4b70-9e0b-866161350e74" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "cinder-quobyte-1107e10a-bf52-4b70-9e0b-866161350e74" acquired by "delete_volume" :: waited 0.019s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:08 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac837ba-e3a0-460a-b5a2-12a3089615eb]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:08 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74 Jun 25 18:12:08 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:09 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74" returned: 0 in 1.036s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:09 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74 Jun 25 18:12:09 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:09 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-f4c03a5f-89c0-4c47-b7b8-4c46c51b19c2 req-97019937-3d03-4aaf-8c5d-722207298659 tempest-AttachVolumeNegativeTest-510956435 None] Terminate volume connection completed successfully. Jun 25 18:12:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-f4c03a5f-89c0-4c47-b7b8-4c46c51b19c2 req-97019937-3d03-4aaf-8c5d-722207298659 tempest-AttachVolumeNegativeTest-510956435 None] Deleting attachment 779259da-c68b-4760-bcfc-302f0bed57f2. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:12:09 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1107e10a-bf52-4b70-9e0b-866161350e74" returned: 0 in 0.919s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "cinder-quobyte-1107e10a-bf52-4b70-9e0b-866161350e74" released by "delete_volume" :: held 2.046s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:10 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Created reservations ['4a1ae419-1208-4bc6-b8c1-d724a9f7ccda', 'ed70c24e-e490-4900-8c1a-c8056c3b6d74', '67320561-0f2d-4d3e-b2e7-bd33c351535b', '3ae076c9-2213-4de7-99d7-6d467180836c'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:12:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:10 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:12:10 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:11 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.634s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:11 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:12:11 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Deleted volume successfully. Jun 25 18:12:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-99761eb2-4d60-45e5-8037-a602883fdbf5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1877185697 None] Lock "cinder-1107e10a-bf52-4b70-9e0b-866161350e74-delete_volume" released by "delete_volume" :: held 4.080s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Flow 'volume_create_manager' (019f42ec-a446-492c-8034-fc677dcaa1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5079f65-7fef-4f8a-8fba-8ecbe6d6461f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5079f65-7fef-4f8a-8fba-8ecbe6d6461f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2002379068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49d08ed-d32c-4d8d-a7a9-44e1da29242f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec01ab904e44493fb5a5c9bad59cb9dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:18Z,use_quota=True,user_id='a179e7f047c34a528468b034e76f1a09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff16640d-af7e-4ea2-9677-edd1db3aed92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff16640d-af7e-4ea2-9677-edd1db3aed92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7485db-8d2b-45aa-ae51-2bdc1beb5e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7485db-8d2b-45aa-ae51-2bdc1beb5e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f49d08ed-d32c-4d8d-a7a9-44e1da29242f', 'volume_name': 'volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e789c89-3cf8-4b57-ab0b-4f63608cd47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e789c89-3cf8-4b57-ab0b-4f63608cd47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec512ac-0b3d-41d5-a248-053a934df442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:18 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Volume f49d08ed-d32c-4d8d-a7a9-44e1da29242f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f', 'volume_size': 1} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2002379068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49d08ed-d32c-4d8d-a7a9-44e1da29242f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec01ab904e44493fb5a5c9bad59cb9dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:18Z,use_quota=True,user_id='a179e7f047c34a528468b034e76f1a09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Creating volume f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:12:18 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:12:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:18 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f 1073741824 Jun 25 18:12:18 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:19 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f 1073741824" returned: 0 in 1.350s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:20 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f Jun 25 18:12:20 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:21 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" returned: 0 in 1.314s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] <== create_volume: return (2735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:12:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.739s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec512ac-0b3d-41d5-a248-053a934df442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b90fe5c-b145-4134-bfef-af549c5a7643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:21 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Volume volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f (f49d08ed-d32c-4d8d-a7a9-44e1da29242f): created successfully Jun 25 18:12:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b90fe5c-b145-4134-bfef-af549c5a7643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Flow 'volume_create_manager' (019f42ec-a446-492c-8034-fc677dcaa1db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:21 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-bbc879b8-3e7f-411e-ad1e-6439ac0479e3 tempest-SnapshotsActionsTest-783064222 None] Created volume successfully. Jun 25 18:12:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] Creating offline snapshot 43384ccc-8b15-4e0e-8e2c-d12449006868 of volume f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:12:22 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[43212623-4392-4e56-9ce0-6634d34c209a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:22 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f Jun 25 18:12:22 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:23 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" returned: 0 in 1.256s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:23 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 1G Jun 25 18:12:23 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:24 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 1G" returned: 0 in 1.357s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:25 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 Jun 25 18:12:25 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:25 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868" returned: 0 in 1.016s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:25 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 is being set with open permissions: ugo+rw Jun 25 18:12:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:26 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 Jun 25 18:12:26 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:26 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868" returned: 0 in 1.001s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:27 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.info Jun 25 18:12:27 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:27 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.info" returned: 0 in 0.944s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:27 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.info is being set with open permissions: ugo+rw Jun 25 18:12:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:28 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.info Jun 25 18:12:28 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:28 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.info" returned: 0 in 0.721s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.480s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:28 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-02c42d6b-b55f-4d6f-b60b-3254f3c03b51 tempest-SnapshotsActionsTest-783064222 None] Create snapshot completed successfully Jun 25 18:12:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] Creating offline snapshot 11e29e9e-29ef-486a-a774-5628e4903420 of volume f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:12:30 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaa3550-8db4-43ac-ad3c-3f74be800366]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:30 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 Jun 25 18:12:30 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:31 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868" returned: 0 in 0.873s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:31 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:12:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:31 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 1G Jun 25 18:12:31 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:32 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 1G" returned: 0 in 1.248s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:32 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 Jun 25 18:12:32 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:33 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420" returned: 0 in 1.357s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:33 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 is being set with open permissions: ugo+rw Jun 25 18:12:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:33 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 Jun 25 18:12:33 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:35 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420" returned: 0 in 1.372s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.004s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:35 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-aa87feea-9f37-4d18-b883-a740c5cf4f9a tempest-SnapshotsActionsTest-783064222 None] Create snapshot completed successfully Jun 25 18:12:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Acquiring lock "cinder-11e29e9e-29ef-486a-a774-5628e4903420-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-11e29e9e-29ef-486a-a774-5628e4903420-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Acquiring lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Acquiring lock "cinder-quobyte-11e29e9e-29ef-486a-a774-5628e4903420" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-11e29e9e-29ef-486a-a774-5628e4903420" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Deleting offline snapshot 11e29e9e-29ef-486a-a774-5628e4903420 of volume f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:12:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] snapshot_file for this snap is: volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:12:36 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c572834-4514-430b-9953-b48a761a143d]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:36 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 Jun 25 18:12:36 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:37 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420" returned: 0 in 0.957s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:12:37 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae57cc4d-48b1-493c-905f-3f689006985a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:37 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 Jun 25 18:12:37 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:38 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868" returned: 0 in 1.138s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:38 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:12:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:38 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 Jun 25 18:12:38 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:12:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:39 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:12:39 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:39 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420" returned: 0 in 1.204s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:39 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420 Jun 25 18:12:39 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Flow 'volume_create_manager' (356de3ee-d471-4be2-83ee-5970bc8b1995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64b0e08-c390-4963-85c4-b8db65b51721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64b0e08-c390-4963-85c4-b8db65b51721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-619860354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36082dd2-bc39-4726-acdc-b5f4b84fc6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9db38245fb94c0cbf56f8aeaa7ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:40Z,use_quota=True,user_id='0ebd6f2fa5354f4c85fc309bc34104d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bb613e-b8da-4278-bb7d-0a6e094919ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bb613e-b8da-4278-bb7d-0a6e094919ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57feb268-548a-4ad2-8043-917a852d6523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57feb268-548a-4ad2-8043-917a852d6523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36082dd2-bc39-4726-acdc-b5f4b84fc6ab', 'volume_name': 'volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7507980f-f00c-441f-b512-063e32c07597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7507980f-f00c-441f-b512-063e32c07597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fe8cc7-5aad-4edb-a03d-081e4c2013d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:40 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Volume 36082dd2-bc39-4726-acdc-b5f4b84fc6ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab', 'volume_size': 1} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-619860354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36082dd2-bc39-4726-acdc-b5f4b84fc6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9db38245fb94c0cbf56f8aeaa7ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:12:40Z,use_quota=True,user_id='0ebd6f2fa5354f4c85fc309bc34104d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Creating volume 36082dd2-bc39-4726-acdc-b5f4b84fc6ab {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:12:40 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:40 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab 1073741824 Jun 25 18:12:40 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:40 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.032s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 8 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:12:40 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.11e29e9e-29ef-486a-a774-5628e4903420" returned: 0 in 0.875s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-11e29e9e-29ef-486a-a774-5628e4903420" released by "_delete_snapshot" :: held 4.330s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" released by "delete_snapshot" :: held 4.365s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Created reservations ['86f06d89-9786-4935-8fed-ce8363a6269d', '6df29499-6174-4aea-9db4-f9470e388da0', '2b7f29c9-664a-4673-8873-d85e2e1a8cd8', '2ec91419-7e75-48f1-8bd5-66a8d29842c0'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:12:40 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Delete snapshot completed successfully. Jun 25 18:12:40 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4702fcfa-d8d0-4606-9f0e-aed8a345b7b1 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-11e29e9e-29ef-486a-a774-5628e4903420-delete_snapshot" released by "delete_snapshot" :: held 4.606s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:41 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab 1073741824" returned: 0 in 1.153s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:41 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab Jun 25 18:12:41 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:42 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab" returned: 0 in 1.080s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:42 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] <== create_volume: return (2293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:12:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.297s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.393s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fe8cc7-5aad-4edb-a03d-081e4c2013d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb7cfe8-d8d6-4f25-863a-e546dc32b8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:12:42 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] Creating offline snapshot e2fefdfb-0cc2-46ac-997e-e8611688da5d of volume f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:12:42 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Volume volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab (36082dd2-bc39-4726-acdc-b5f4b84fc6ab): created successfully Jun 25 18:12:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb7cfe8-d8d6-4f25-863a-e546dc32b8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:12:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Flow 'volume_create_manager' (356de3ee-d471-4be2-83ee-5970bc8b1995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:12:42 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddbced9-eed5-4080-8a3d-411d7bf56998]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:42 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-b08b6b69-5dd0-467a-9a7f-d780b4423a29 tempest-AttachVolumeTestJSON-1368507731 None] Created volume successfully. Jun 25 18:12:42 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 Jun 25 18:12:42 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:44 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868" returned: 0 in 1.370s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:12:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:44 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d 1G Jun 25 18:12:44 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:45 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d 1G" returned: 0 in 1.819s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:45 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d Jun 25 18:12:45 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:47 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d" returned: 0 in 1.664s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:47 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d is being set with open permissions: ugo+rw Jun 25 18:12:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:47 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d Jun 25 18:12:47 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:47 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=60,cinder:UPDATE=64,cinder:INSERT=17,cinder:DELETE=6 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:12:47 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=65,cinder:SELECT=70,cinder:INSERT=12,cinder:DELETE=2 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:12:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-027e325f-264e-4d7a-bc79-9176843c5424 req-d42a1271-b2bc-4966-8f10-e5eca4a5fc0f tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:48 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d" returned: 0 in 1.179s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.260s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-027e325f-264e-4d7a-bc79-9176843c5424 req-d42a1271-b2bc-4966-8f10-e5eca4a5fc0f tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:48 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[27332eaa-c959-43eb-96cc-1ccb921b38e9]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-027e325f-264e-4d7a-bc79-9176843c5424 req-d42a1271-b2bc-4966-8f10-e5eca4a5fc0f tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:48 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-71ba1c75-1386-471d-934b-9f3238e763f8 tempest-SnapshotsActionsTest-783064222 None] Create snapshot completed successfully Jun 25 18:12:49 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab Jun 25 18:12:49 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:50 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-027e325f-264e-4d7a-bc79-9176843c5424 req-d42a1271-b2bc-4966-8f10-e5eca4a5fc0f tempest-AttachVolumeTestJSON-1368507731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab" returned: 0 in 1.601s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-027e325f-264e-4d7a-bc79-9176843c5424 req-d42a1271-b2bc-4966-8f10-e5eca4a5fc0f tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.638s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:12:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Acquiring lock "cinder-e2fefdfb-0cc2-46ac-997e-e8611688da5d-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-027e325f-264e-4d7a-bc79-9176843c5424 req-d42a1271-b2bc-4966-8f10-e5eca4a5fc0f tempest-AttachVolumeTestJSON-1368507731 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba42c4a2-4636-4178-9935-c80a6c45e0ed', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:12:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-e2fefdfb-0cc2-46ac-997e-e8611688da5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Acquiring lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" acquired by "delete_snapshot" :: waited 0.059s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Acquiring lock "cinder-quobyte-e2fefdfb-0cc2-46ac-997e-e8611688da5d" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:12:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-e2fefdfb-0cc2-46ac-997e-e8611688da5d" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:12:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Deleting offline snapshot e2fefdfb-0cc2-46ac-997e-e8611688da5d of volume f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:12:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] snapshot_file for this snap is: volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:12:50 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6499f6-f877-4378-9dec-eabd77f111d8]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:50 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-027e325f-264e-4d7a-bc79-9176843c5424 req-d42a1271-b2bc-4966-8f10-e5eca4a5fc0f tempest-AttachVolumeTestJSON-1368507731 None] attachment_update completed successfully. Jun 25 18:12:50 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d Jun 25 18:12:50 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:51 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d" returned: 0 in 1.239s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:51 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:12:52 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[76caa4ec-50b5-45da-809f-f9d47caac362]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:52 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 Jun 25 18:12:52 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:53 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868" returned: 0 in 1.397s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:12:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:53 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d Jun 25 18:12:53 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:54 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d" returned: 0 in 1.430s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:54 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d Jun 25 18:12:54 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:55 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.e2fefdfb-0cc2-46ac-997e-e8611688da5d" returned: 0 in 0.877s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:55 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-e2fefdfb-0cc2-46ac-997e-e8611688da5d" released by "_delete_snapshot" :: held 5.124s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:55 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" released by "delete_snapshot" :: held 5.190s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:55 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Created reservations ['b1878a68-e18c-4dd8-a769-7ff53902a260', '1cdc11bc-5c4d-42c3-9e85-e3fa300e1786', '318f2bd1-88c3-4550-b455-49c331ef6a17', '2edfa7b9-53fe-4625-96c2-04c15526399f'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:12:56 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Delete snapshot completed successfully. Jun 25 18:12:56 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-014a5146-5843-42ac-8c10-c9e9ba32acd0 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-e2fefdfb-0cc2-46ac-997e-e8611688da5d-delete_snapshot" released by "delete_snapshot" :: held 5.542s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:12:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:12:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:12:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] Creating offline snapshot 8cd787bf-90f2-4f05-a448-2159ea34adbf of volume f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:12:57 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b7b1ae-67ab-42f4-8299-eb7214f7c714]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:12:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:57 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 Jun 25 18:12:57 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:12:58 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jun 25 18:12:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868" returned: 0 in 1.062s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:12:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:12:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:12:58 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf 1G Jun 25 18:12:58 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:00 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf 1G" returned: 0 in 1.410s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:00 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf Jun 25 18:13:00 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:00 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf" returned: 0 in 0.864s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:00 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf is being set with open permissions: ugo+rw Jun 25 18:13:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:00 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf Jun 25 18:13:00 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:01 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf" returned: 0 in 0.796s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.284s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:01 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e5fb0310-7c27-4999-a7ec-4d51fd8abac6 tempest-SnapshotsActionsTest-783064222 None] Create snapshot completed successfully Jun 25 18:13:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Acquiring lock "cinder-8cd787bf-90f2-4f05-a448-2159ea34adbf-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-8cd787bf-90f2-4f05-a448-2159ea34adbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Acquiring lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Acquiring lock "cinder-quobyte-8cd787bf-90f2-4f05-a448-2159ea34adbf" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-8cd787bf-90f2-4f05-a448-2159ea34adbf" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Deleting offline snapshot 8cd787bf-90f2-4f05-a448-2159ea34adbf of volume f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:13:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] snapshot_file for this snap is: volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:13:03 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecdf6b2-113e-4f4f-ac9f-a25a5fe1d112]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:03 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf Jun 25 18:13:03 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:04 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf" returned: 0 in 1.219s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:13:04 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a7c49d-88b8-4ae5-8bff-4614a4530e85]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:04 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 Jun 25 18:13:04 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:05 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868" returned: 0 in 1.036s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:13:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:05 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf Jun 25 18:13:05 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Flow 'volume_create_manager' (e2a7be05-8f15-4bd9-99c9-a3749c02661b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c829164-53c2-423e-9a62-b2e2789cf2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c829164-53c2-423e-9a62-b2e2789cf2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1880400308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4650cb-b9dd-4f5c-a00c-35aa9cbda197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e4d327116441b7a53975dd0fbc05d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:06Z,use_quota=True,user_id='5bd08726b0ec43aa9cee47131561485c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca23d46e-ed40-4f79-87e3-d54cca28dd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca23d46e-ed40-4f79-87e3-d54cca28dd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca90021e-27a7-4b78-9043-b5148b3b4a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca90021e-27a7-4b78-9043-b5148b3b4a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4650cb-b9dd-4f5c-a00c-35aa9cbda197', 'volume_name': 'volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02625d4-a8f2-458a-b896-35c94fabae55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02625d4-a8f2-458a-b896-35c94fabae55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f867849e-9871-4016-9b59-6d8f3ba437ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:06 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Volume 1f4650cb-b9dd-4f5c-a00c-35aa9cbda197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197', 'volume_size': 1} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1880400308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4650cb-b9dd-4f5c-a00c-35aa9cbda197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e4d327116441b7a53975dd0fbc05d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:06Z,use_quota=True,user_id='5bd08726b0ec43aa9cee47131561485c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Creating volume 1f4650cb-b9dd-4f5c-a00c-35aa9cbda197 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:13:06 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:06 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197 1073741824 Jun 25 18:13:06 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:06 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf" returned: 0 in 1.261s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:06 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf Jun 25 18:13:06 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:07 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197 1073741824" returned: 0 in 1.280s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:07 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.8cd787bf-90f2-4f05-a448-2159ea34adbf" returned: 0 in 1.064s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-8cd787bf-90f2-4f05-a448-2159ea34adbf" released by "_delete_snapshot" :: held 4.784s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" released by "delete_snapshot" :: held 4.840s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:07 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197 Jun 25 18:13:07 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:08 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Created reservations ['3a8d4639-bc16-4c96-8c19-fd39caa6a787', '107e2395-9cca-4fe6-a5cc-d2226bc83fdf', 'fba368c5-1a59-4812-8e06-4da3925c4d68', '0b0f91b5-bbd5-4f6c-973d-b487bd222c90'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:13:08 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Delete snapshot completed successfully. Jun 25 18:13:08 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-892d00c8-5063-4e99-be6f-fff274fc11ef tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-8cd787bf-90f2-4f05-a448-2159ea34adbf-delete_snapshot" released by "delete_snapshot" :: held 5.057s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:08 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197" returned: 0 in 0.899s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] <== create_volume: return (2311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:13:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.316s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f867849e-9871-4016-9b59-6d8f3ba437ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f9e02f-93ec-43da-a04d-5cd04bc8fcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:08 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Volume volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197 (1f4650cb-b9dd-4f5c-a00c-35aa9cbda197): created successfully Jun 25 18:13:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f9e02f-93ec-43da-a04d-5cd04bc8fcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Flow 'volume_create_manager' (e2a7be05-8f15-4bd9-99c9-a3749c02661b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:08 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d2cd5cdf-8299-432f-8c6b-c3f3fe9e2a8a tempest-AttachVolumeNegativeTest-510956435 None] Created volume successfully. Jun 25 18:13:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] Creating offline snapshot 5b710c5b-d441-4ccf-8247-bba42741286d of volume f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:13:09 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1df36d3-44d5-43d2-a0e3-5ccc8b8918dc]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:09 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 Jun 25 18:13:09 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:09 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868" returned: 0 in 0.960s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:13:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:10 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d 1G Jun 25 18:13:10 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:11 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d 1G" returned: 0 in 1.537s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:11 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d Jun 25 18:13:11 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:12 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d" returned: 0 in 0.948s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:12 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d is being set with open permissions: ugo+rw Jun 25 18:13:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:12 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d Jun 25 18:13:12 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:13 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d" returned: 0 in 0.840s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.466s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:13 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-8019d73e-625f-4f57-b93d-952a95ce10ca tempest-SnapshotsActionsTest-783064222 None] Create snapshot completed successfully Jun 25 18:13:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-527c5bfb-fba4-4da4-840c-03ef7384a30e req-5e582cbf-e0e6-457c-a347-6116d6a370a6 tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-527c5bfb-fba4-4da4-840c-03ef7384a30e req-5e582cbf-e0e6-457c-a347-6116d6a370a6 tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:13 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b7b216-61ad-4539-a173-1ead3ddb65a4]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-527c5bfb-fba4-4da4-840c-03ef7384a30e req-5e582cbf-e0e6-457c-a347-6116d6a370a6 tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:13 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197 Jun 25 18:13:13 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Acquiring lock "cinder-5b710c5b-d441-4ccf-8247-bba42741286d-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-5b710c5b-d441-4ccf-8247-bba42741286d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Acquiring lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Acquiring lock "cinder-quobyte-5b710c5b-d441-4ccf-8247-bba42741286d" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-5b710c5b-d441-4ccf-8247-bba42741286d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Deleting offline snapshot 5b710c5b-d441-4ccf-8247-bba42741286d of volume f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:13:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] snapshot_file for this snap is: volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:13:14 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[000cd75a-35dc-4adf-b99f-707ac62be2dd]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:14 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d Jun 25 18:13:14 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:14 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-527c5bfb-fba4-4da4-840c-03ef7384a30e req-5e582cbf-e0e6-457c-a347-6116d6a370a6 tempest-AttachVolumeNegativeTest-510956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197" returned: 0 in 1.355s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-527c5bfb-fba4-4da4-840c-03ef7384a30e req-5e582cbf-e0e6-457c-a347-6116d6a370a6 tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.394s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-527c5bfb-fba4-4da4-840c-03ef7384a30e req-5e582cbf-e0e6-457c-a347-6116d6a370a6 tempest-AttachVolumeNegativeTest-510956435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b19d2b02-4b25-4016-9033-c1f0231690e0', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:13:15 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-527c5bfb-fba4-4da4-840c-03ef7384a30e req-5e582cbf-e0e6-457c-a347-6116d6a370a6 tempest-AttachVolumeNegativeTest-510956435 None] attachment_update completed successfully. Jun 25 18:13:15 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d" returned: 0 in 1.159s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:15 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:13:15 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bbc509-c7c5-428d-8c83-2fa02af141a5]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:15 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 Jun 25 18:13:15 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:16 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868" returned: 0 in 1.151s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:13:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:16 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d Jun 25 18:13:16 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:18 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d" returned: 0 in 1.251s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:18 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d Jun 25 18:13:18 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:19 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.5b710c5b-d441-4ccf-8247-bba42741286d" returned: 0 in 0.937s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-5b710c5b-d441-4ccf-8247-bba42741286d" released by "_delete_snapshot" :: held 4.645s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" released by "delete_snapshot" :: held 4.681s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:19 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Created reservations ['05f0fd72-4783-4c56-a8cc-612fe148f8de', 'be596bd8-718d-42ad-b8d3-197f7633a974', 'e431ca04-7d25-4b57-a581-53a36518d4ce', '09d81e62-5dac-4a6f-a6e2-d58fd2357f90'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:13:19 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Delete snapshot completed successfully. Jun 25 18:13:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ac6682c-a620-4449-ac77-f95c3f6d3c38 tempest-SnapshotsActionsTest-1872092803 None] Lock "cinder-5b710c5b-d441-4ccf-8247-bba42741286d-delete_snapshot" released by "delete_snapshot" :: held 4.884s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Acquiring lock "cinder-43384ccc-8b15-4e0e-8e2c-d12449006868-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Lock "cinder-43384ccc-8b15-4e0e-8e2c-d12449006868-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Acquiring lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Acquiring lock "cinder-quobyte-43384ccc-8b15-4e0e-8e2c-d12449006868" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Lock "cinder-quobyte-43384ccc-8b15-4e0e-8e2c-d12449006868" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Deleting offline snapshot 43384ccc-8b15-4e0e-8e2c-d12449006868 of volume f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:13:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] snapshot_file for this snap is: volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:13:20 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d37eb82-513e-4a86-8606-3f7a58aa6944]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:20 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 Jun 25 18:13:20 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:21 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-fd9550a0-01ae-49de-ab0b-93abe89e6661 req-51d1278d-0e60-48ed-8a83-d1d534a08dad tempest-AttachVolumeNegativeTest-510956435 None] Terminate volume connection completed successfully. Jun 25 18:13:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-fd9550a0-01ae-49de-ab0b-93abe89e6661 req-51d1278d-0e60-48ed-8a83-d1d534a08dad tempest-AttachVolumeNegativeTest-510956435 None] Deleting attachment b19d2b02-4b25-4016-9033-c1f0231690e0. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:13:21 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868" returned: 0 in 1.035s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:13:21 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaa0c1b-afbf-4b37-81d8-b6cad78c606a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:21 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f Jun 25 18:13:21 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:22 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" returned: 0 in 0.938s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:22 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 Jun 25 18:13:22 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:23 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868" returned: 0 in 0.930s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:23 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868 Jun 25 18:13:23 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:24 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f.43384ccc-8b15-4e0e-8e2c-d12449006868" returned: 0 in 1.039s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:24 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Lock "cinder-quobyte-43384ccc-8b15-4e0e-8e2c-d12449006868" released by "_delete_snapshot" :: held 4.071s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:24 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" released by "delete_snapshot" :: held 4.103s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:24 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Created reservations ['ad21d576-04b1-411c-a9b5-47fc40101ced', '719f73c4-0acc-44f1-9f10-60339c8fcb2d', 'b06343aa-b166-4bf1-ad34-e7dfd376f007', 'cf1abdc2-331c-455d-8e21-79b4e80af032'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:13:25 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Delete snapshot completed successfully. Jun 25 18:13:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7ed8d46a-890b-422e-8813-9e719be5f305 tempest-SnapshotsActionsTest-783064222 None] Lock "cinder-43384ccc-8b15-4e0e-8e2c-d12449006868-delete_snapshot" released by "delete_snapshot" :: held 4.645s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Acquiring lock "cinder-f49d08ed-d32c-4d8d-a7a9-44e1da29242f-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Lock "cinder-f49d08ed-d32c-4d8d-a7a9-44e1da29242f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Acquiring lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" acquired by "delete_volume" :: waited 0.035s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:26 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaccbbf-59f5-438f-b790-0c66d425ad69]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:26 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f Jun 25 18:13:26 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:27 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" returned: 0 in 1.289s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:27 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f Jun 25 18:13:27 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:29 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" returned: 0 in 1.167s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Lock "cinder-quobyte-f49d08ed-d32c-4d8d-a7a9-44e1da29242f" released by "delete_volume" :: held 2.570s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:29 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Created reservations ['8c3cca32-d77d-4eca-853e-9c206bf5dd23', '27837fd8-05f6-43be-8704-78f03975fae2', 'eacfe9f6-a7fc-4ffa-934d-0d6ab6336d73', 'ee3bce78-8a48-4cb1-af81-43496512f740'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:13:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:29 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:13:29 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:30 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.264s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:30 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:13:30 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Deleted volume successfully. Jun 25 18:13:30 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f16692c6-7f54-4f02-9bf2-247193180a8f tempest-SnapshotsActionsTest-783064222 None] Lock "cinder-f49d08ed-d32c-4d8d-a7a9-44e1da29242f-delete_volume" released by "delete_volume" :: held 4.264s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:30 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:13:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Flow 'volume_create_manager' (5548e8fc-999c-4c8c-9b96-0009b745da11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95bd392c-cbc0-4f0b-b0fe-23791f4b19f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95bd392c-cbc0-4f0b-b0fe-23791f4b19f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2044798170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe6fad6-e529-4e37-b7e0-117595da9216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b144e84ab24b99b916f2f990f05d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:31Z,use_quota=True,user_id='f9470720f8204ae7858067ddd3a72705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8e892f-df99-4c64-9f05-e0481fd94650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8e892f-df99-4c64-9f05-e0481fd94650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24f9d29-69c0-4a45-b997-417dd8bf141e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24f9d29-69c0-4a45-b997-417dd8bf141e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fe6fad6-e529-4e37-b7e0-117595da9216', 'volume_name': 'volume-2fe6fad6-e529-4e37-b7e0-117595da9216', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653f85a9-51e4-4dc2-b539-ac89591e210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653f85a9-51e4-4dc2-b539-ac89591e210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04feb65-031c-4cf9-b6be-478b81f1078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:31 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Volume 2fe6fad6-e529-4e37-b7e0-117595da9216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fe6fad6-e529-4e37-b7e0-117595da9216', 'volume_size': 1} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2044798170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe6fad6-e529-4e37-b7e0-117595da9216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b144e84ab24b99b916f2f990f05d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:31Z,use_quota=True,user_id='f9470720f8204ae7858067ddd3a72705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Creating volume 2fe6fad6-e529-4e37-b7e0-117595da9216 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:13:31 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:13:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2fe6fad6-e529-4e37-b7e0-117595da9216 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:31 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2fe6fad6-e529-4e37-b7e0-117595da9216 1073741824 Jun 25 18:13:31 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:32 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2fe6fad6-e529-4e37-b7e0-117595da9216 1073741824" returned: 0 in 1.229s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2fe6fad6-e529-4e37-b7e0-117595da9216 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:32 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2fe6fad6-e529-4e37-b7e0-117595da9216 Jun 25 18:13:32 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:33 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2fe6fad6-e529-4e37-b7e0-117595da9216" returned: 0 in 0.989s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:33 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] <== create_volume: return (2289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:13:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.296s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04feb65-031c-4cf9-b6be-478b81f1078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fe6fad6-e529-4e37-b7e0-117595da9216', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d257b1b1-26ac-487c-8c04-663da080c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:33 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Volume volume-2fe6fad6-e529-4e37-b7e0-117595da9216 (2fe6fad6-e529-4e37-b7e0-117595da9216): created successfully Jun 25 18:13:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d257b1b1-26ac-487c-8c04-663da080c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Flow 'volume_create_manager' (5548e8fc-999c-4c8c-9b96-0009b745da11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:33 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-5eb37f61-e87d-4741-b329-849e101ebab9 tempest-VolumesActionsTest-1135227393 None] Created volume successfully. Jun 25 18:13:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "cinder-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Lock "cinder-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "cinder-quobyte-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Lock "cinder-quobyte-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197" acquired by "delete_volume" :: waited 0.019s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:34 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb36937b-12f5-4d57-bd5c-d85fde1d105b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3a19d1d1-55fb-4e4c-a342-c8fadbe32fca tempest-VolumesActionsTest-1135227393 None] Acquiring lock "cinder-2fe6fad6-e529-4e37-b7e0-117595da9216" by "attach_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3a19d1d1-55fb-4e4c-a342-c8fadbe32fca tempest-VolumesActionsTest-1135227393 None] Lock "cinder-2fe6fad6-e529-4e37-b7e0-117595da9216" acquired by "attach_volume" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:34 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197 Jun 25 18:13:34 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:34 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-3a19d1d1-55fb-4e4c-a342-c8fadbe32fca tempest-VolumesActionsTest-1135227393 None] Attaching volume 2fe6fad6-e529-4e37-b7e0-117595da9216 to instance 4590669a-a73a-4585-a2d6-531f2d9dbca9 at mountpoint /dev/vdb on host None. Jun 25 18:13:34 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-3a19d1d1-55fb-4e4c-a342-c8fadbe32fca tempest-VolumesActionsTest-1135227393 None] Attach volume completed successfully. Jun 25 18:13:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3a19d1d1-55fb-4e4c-a342-c8fadbe32fca tempest-VolumesActionsTest-1135227393 None] Lock "cinder-2fe6fad6-e529-4e37-b7e0-117595da9216" released by "attach_volume" :: held 0.342s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:35 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197" returned: 0 in 1.297s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:35 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197 Jun 25 18:13:35 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:35 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d92e7cc4-c55b-4fc5-8d0e-f9b6db0ba6d1 tempest-VolumesActionsTest-1239401262 None] Terminate volume connection completed successfully. Jun 25 18:13:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d92e7cc4-c55b-4fc5-8d0e-f9b6db0ba6d1 tempest-VolumesActionsTest-1239401262 None] Acquiring lock "cinder-2fe6fad6-e529-4e37-b7e0-117595da9216-detach_volume" by "detach_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:36 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197" returned: 0 in 0.902s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Lock "cinder-quobyte-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197" released by "delete_volume" :: held 2.268s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d92e7cc4-c55b-4fc5-8d0e-f9b6db0ba6d1 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-2fe6fad6-e529-4e37-b7e0-117595da9216-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:36 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d92e7cc4-c55b-4fc5-8d0e-f9b6db0ba6d1 tempest-VolumesActionsTest-1239401262 None] Detaching volume 2fe6fad6-e529-4e37-b7e0-117595da9216 from instance 4590669a-a73a-4585-a2d6-531f2d9dbca9. Jun 25 18:13:36 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Created reservations ['7769c7ca-1cb1-4d2f-9184-9e85fed0e79e', '0dce4749-31a0-424d-886f-83e001d3b735', 'a59e07fb-0d4a-4135-8174-4f4f7846656f', 'f07a5c33-d4d6-4f4f-81e6-3129adfdfb28'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:13:36 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d92e7cc4-c55b-4fc5-8d0e-f9b6db0ba6d1 tempest-VolumesActionsTest-1239401262 None] Detach volume completed successfully. Jun 25 18:13:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d92e7cc4-c55b-4fc5-8d0e-f9b6db0ba6d1 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-2fe6fad6-e529-4e37-b7e0-117595da9216-detach_volume" released by "detach_volume" :: held 0.167s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:36 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:13:36 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0fcb7065-5386-45f7-9fed-3c4ed8000775 tempest-VolumesActionsTest-1135227393 None] Acquiring lock "cinder-2fe6fad6-e529-4e37-b7e0-117595da9216-detach_volume" by "detach_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0fcb7065-5386-45f7-9fed-3c4ed8000775 tempest-VolumesActionsTest-1135227393 None] Lock "cinder-2fe6fad6-e529-4e37-b7e0-117595da9216-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:37 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-0fcb7065-5386-45f7-9fed-3c4ed8000775 tempest-VolumesActionsTest-1135227393 None] Volume detach called, but volume not attached. Jun 25 18:13:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0fcb7065-5386-45f7-9fed-3c4ed8000775 tempest-VolumesActionsTest-1135227393 None] Lock "cinder-2fe6fad6-e529-4e37-b7e0-117595da9216-detach_volume" released by "detach_volume" :: held 0.050s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:37 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-237e6ba5-9408-41bd-899c-0801c0c1d4f9 req-2315627f-ccbd-45a5-abe2-5d0660ad0ff4 tempest-AttachVolumeTestJSON-1368507731 None] Terminate volume connection completed successfully. Jun 25 18:13:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-237e6ba5-9408-41bd-899c-0801c0c1d4f9 req-2315627f-ccbd-45a5-abe2-5d0660ad0ff4 tempest-AttachVolumeTestJSON-1368507731 None] Deleting attachment ba42c4a2-4636-4178-9935-c80a6c45e0ed. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:13:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "cinder-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Lock "cinder-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:37 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.206s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:37 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:13:38 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Deleted volume successfully. Jun 25 18:13:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "cinder-quobyte-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Lock "cinder-quobyte-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43" acquired by "delete_volume" :: waited 0.035s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-91d51667-440c-4ec8-8197-4569298b2e53 tempest-AttachVolumeNegativeTest-510956435 None] Lock "cinder-1f4650cb-b9dd-4f5c-a00c-35aa9cbda197-delete_volume" released by "delete_volume" :: held 4.003s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:38 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0dde08-c8e8-438c-b202-bff5372af7b0]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:38 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43 Jun 25 18:13:38 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Acquiring lock "cinder-2fe6fad6-e529-4e37-b7e0-117595da9216-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Lock "cinder-2fe6fad6-e529-4e37-b7e0-117595da9216-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Acquiring lock "cinder-quobyte-2fe6fad6-e529-4e37-b7e0-117595da9216" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Lock "cinder-quobyte-2fe6fad6-e529-4e37-b7e0-117595da9216" acquired by "delete_volume" :: waited 0.029s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:38 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95d8db1-3c25-4a7b-a465-9890da486efb]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2fe6fad6-e529-4e37-b7e0-117595da9216 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:38 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2fe6fad6-e529-4e37-b7e0-117595da9216 Jun 25 18:13:38 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:13:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:39 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:13:39 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:39 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43" returned: 0 in 1.759s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:39 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43 Jun 25 18:13:39 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:40 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2fe6fad6-e529-4e37-b7e0-117595da9216" returned: 0 in 1.782s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2fe6fad6-e529-4e37-b7e0-117595da9216 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:40 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2fe6fad6-e529-4e37-b7e0-117595da9216 Jun 25 18:13:40 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:40 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43" returned: 0 in 1.080s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:40 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Lock "cinder-quobyte-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43" released by "delete_volume" :: held 2.933s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:41 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.746s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:41 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:13:41 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Created reservations ['c71b7abb-62ff-433d-8adf-7cbe02692ce6', 'f93db376-d3ae-4810-aaa6-cf9a8443d36b', '4bc2df98-e7d9-445b-a5df-44f0ebffd417', '9ae58c56-9b0b-456f-b5de-faf2964ee05f'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:13:41 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:13:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 8 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:13:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:13:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:41 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:13:41 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:41 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2fe6fad6-e529-4e37-b7e0-117595da9216" returned: 0 in 1.356s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Lock "cinder-quobyte-2fe6fad6-e529-4e37-b7e0-117595da9216" released by "delete_volume" :: held 3.223s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Created reservations ['6ee7ea9e-59f4-4428-90f9-c792667aca1a', '29679f33-63eb-49a7-b3ed-da5a5f11d548', '4d03c2b1-b009-4eda-b1e8-caa34b4863ac', '4ca305af-45ce-4d37-a8ae-c1cf40a1667c'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:42 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:13:42 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "cinder-02efbdde-8b4e-43fb-b6f2-9b11824161ec-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Lock "cinder-02efbdde-8b4e-43fb-b6f2-9b11824161ec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "cinder-quobyte-02efbdde-8b4e-43fb-b6f2-9b11824161ec" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Lock "cinder-quobyte-02efbdde-8b4e-43fb-b6f2-9b11824161ec" acquired by "delete_volume" :: waited 0.034s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbac73a-79cc-4848-a9b0-d787be1de59a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:42 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec Jun 25 18:13:42 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:42 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.431s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:13:42 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Deleted volume successfully. Jun 25 18:13:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4e5d8d59-59a6-4768-8054-4304a65c459d tempest-AttachVolumeNegativeTest-510956435 None] Lock "cinder-faf703cf-a76e-4c02-ba2d-5ba5c3f48f43-delete_volume" released by "delete_volume" :: held 4.992s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:43 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.991s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:43 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:13:43 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Deleted volume successfully. Jun 25 18:13:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-354f7833-93e5-4d7c-ba5a-a721c5cdad6c tempest-VolumesActionsTest-1135227393 None] Lock "cinder-2fe6fad6-e529-4e37-b7e0-117595da9216-delete_volume" released by "delete_volume" :: held 4.616s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:43 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec" returned: 0 in 1.002s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:43 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec Jun 25 18:13:43 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:44 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-02efbdde-8b4e-43fb-b6f2-9b11824161ec" returned: 0 in 0.719s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Lock "cinder-quobyte-02efbdde-8b4e-43fb-b6f2-9b11824161ec" released by "delete_volume" :: held 1.779s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:44 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Created reservations ['90e4c933-228f-44b9-8d1c-6462e9f9ba20', '49f56319-bfb7-40f9-9ef1-5650adc9cd11', '0d7aea07-e4ee-4c92-a8f6-2fd95cbd491c', '3ab620a2-374e-4b15-8173-e5a1358f5c38'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:13:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:44 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:13:44 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:45 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.987s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:45 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:13:45 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Deleted volume successfully. Jun 25 18:13:45 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-10c93f5b-780b-4f10-ab1a-5f5d5c598a38 tempest-AttachVolumeNegativeTest-510956435 None] Lock "cinder-02efbdde-8b4e-43fb-b6f2-9b11824161ec-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:51 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=83,cinder:DELETE=6,cinder:INSERT=14,cinder:UPDATE=71 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=66,cinder:UPDATE=84,cinder:INSERT=26,cinder:DELETE=4 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Flow 'volume_create_manager' (f7efab11-082a-4275-97c3-c2e5e3f1a610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72e8f6c-98df-4daf-b974-10286cccc2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72e8f6c-98df-4daf-b974-10286cccc2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1481596473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ccc894-b8f9-4b13-92db-b16cc4e94428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b144e84ab24b99b916f2f990f05d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:52Z,use_quota=True,user_id='f9470720f8204ae7858067ddd3a72705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f290c0-ffcc-4da5-af03-98e04d31026b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f290c0-ffcc-4da5-af03-98e04d31026b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfdbca57-ab8d-460c-9478-6cd7ae862e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfdbca57-ab8d-460c-9478-6cd7ae862e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ccc894-b8f9-4b13-92db-b16cc4e94428', 'volume_name': 'volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570c1925-c9fe-40e8-9b3b-557dc4509ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570c1925-c9fe-40e8-9b3b-557dc4509ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db2bc2b-f10d-4c29-af32-3e407dd62db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:52 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Volume a0ccc894-b8f9-4b13-92db-b16cc4e94428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428', 'volume_size': 1} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1481596473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ccc894-b8f9-4b13-92db-b16cc4e94428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b144e84ab24b99b916f2f990f05d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:52Z,use_quota=True,user_id='f9470720f8204ae7858067ddd3a72705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Creating volume a0ccc894-b8f9-4b13-92db-b16cc4e94428 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:13:52 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:52 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428 1073741824 Jun 25 18:13:52 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Flow 'volume_create_manager' (13c890e5-3641-4a09-b27c-c455a6fdd681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90559bd8-149a-4a04-94c3-8a4b9cd226df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90559bd8-149a-4a04-94c3-8a4b9cd226df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1478169356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7641704c-96af-4799-9fed-0024ed498d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155981c951ca439aa707487a89bf7e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:53Z,use_quota=True,user_id='a4c6312d900243ad8445205d276a9eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda567b1-23cc-4ea0-b33d-eb4138fffdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda567b1-23cc-4ea0-b33d-eb4138fffdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c115dc00-8f83-4e06-a88c-d5a1781ba2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c115dc00-8f83-4e06-a88c-d5a1781ba2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7641704c-96af-4799-9fed-0024ed498d93', 'volume_name': 'volume-7641704c-96af-4799-9fed-0024ed498d93', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed530da5-f7af-4b46-8696-e84979886984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed530da5-f7af-4b46-8696-e84979886984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d20f721-0be5-41c3-834c-9ac39cbe1e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:53 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Volume 7641704c-96af-4799-9fed-0024ed498d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7641704c-96af-4799-9fed-0024ed498d93', 'volume_size': 1} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:53 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428 1073741824" returned: 0 in 1.074s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:53 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428 Jun 25 18:13:53 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:53 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428" returned: 0 in 0.706s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.925s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1478169356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7641704c-96af-4799-9fed-0024ed498d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155981c951ca439aa707487a89bf7e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:53Z,use_quota=True,user_id='a4c6312d900243ad8445205d276a9eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Creating volume 7641704c-96af-4799-9fed-0024ed498d93 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:13:53 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7641704c-96af-4799-9fed-0024ed498d93 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:53 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7641704c-96af-4799-9fed-0024ed498d93 1073741824 Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db2bc2b-f10d-4c29-af32-3e407dd62db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:53 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f51df7-75ff-465b-9675-c499939d62bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:54 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Volume volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428 (a0ccc894-b8f9-4b13-92db-b16cc4e94428): created successfully Jun 25 18:13:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f51df7-75ff-465b-9675-c499939d62bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Flow 'volume_create_manager' (f7efab11-082a-4275-97c3-c2e5e3f1a610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:54 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-a4ad7511-6085-4ea8-9c59-0a534e921980 tempest-VolumesActionsTest-1135227393 None] Created volume successfully. Jun 25 18:13:55 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7641704c-96af-4799-9fed-0024ed498d93 1073741824" returned: 0 in 1.164s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7641704c-96af-4799-9fed-0024ed498d93 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:55 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7641704c-96af-4799-9fed-0024ed498d93 Jun 25 18:13:55 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Flow 'volume_create_manager' (b2b1ba4c-a009-4d97-8b8f-fc95859e2127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7cf5e6-080f-4529-a554-7063813a6fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7cf5e6-080f-4529-a554-7063813a6fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-937899014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a012af56-3c25-40d0-a83a-0878187ce2a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ba13f5da1e40d0b5e82c1ae9a4ef24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:55Z,use_quota=True,user_id='39dd2ed029f74c7d848f95cbf1cddef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01166ab3-aaeb-4af9-933e-5c5d19fe8126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01166ab3-aaeb-4af9-933e-5c5d19fe8126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b4f900-c44e-4351-bd39-ed29ba20842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b4f900-c44e-4351-bd39-ed29ba20842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a012af56-3c25-40d0-a83a-0878187ce2a4', 'volume_name': 'volume-a012af56-3c25-40d0-a83a-0878187ce2a4', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70b46f9-a502-4fdc-ba43-a844daee168b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70b46f9-a502-4fdc-ba43-a844daee168b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f959fad-d117-41fc-90ff-6198111a0e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:55 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Volume a012af56-3c25-40d0-a83a-0878187ce2a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a012af56-3c25-40d0-a83a-0878187ce2a4', 'volume_size': 1} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Acquiring lock "cinder-a0ccc894-b8f9-4b13-92db-b16cc4e94428-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-a0ccc894-b8f9-4b13-92db-b16cc4e94428-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Acquiring lock "cinder-quobyte-a0ccc894-b8f9-4b13-92db-b16cc4e94428" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-quobyte-a0ccc894-b8f9-4b13-92db-b16cc4e94428" acquired by "delete_volume" :: waited 0.039s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[737fad9b-1ae0-4718-acea-67b311a46126]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:55 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428 Jun 25 18:13:55 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:56 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7641704c-96af-4799-9fed-0024ed498d93" returned: 0 in 1.259s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] <== create_volume: return (2530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.533s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.033s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-937899014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a012af56-3c25-40d0-a83a-0878187ce2a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ba13f5da1e40d0b5e82c1ae9a4ef24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:13:55Z,use_quota=True,user_id='39dd2ed029f74c7d848f95cbf1cddef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Creating volume a012af56-3c25-40d0-a83a-0878187ce2a4 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:13:56 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:56 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4 1073741824 Jun 25 18:13:56 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d20f721-0be5-41c3-834c-9ac39cbe1e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7641704c-96af-4799-9fed-0024ed498d93', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7afe57-3b40-4dca-8746-edd909840e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:56 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Volume volume-7641704c-96af-4799-9fed-0024ed498d93 (7641704c-96af-4799-9fed-0024ed498d93): created successfully Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7afe57-3b40-4dca-8746-edd909840e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Flow 'volume_create_manager' (13c890e5-3641-4a09-b27c-c455a6fdd681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:56 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-c21b6391-40fc-419e-9937-95c490933b81 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Created volume successfully. Jun 25 18:13:56 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428" returned: 0 in 1.310s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:57 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428 Jun 25 18:13:57 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:57 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4 1073741824" returned: 0 in 1.195s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:57 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4 Jun 25 18:13:57 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:58 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a0ccc894-b8f9-4b13-92db-b16cc4e94428" returned: 0 in 1.057s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-quobyte-a0ccc894-b8f9-4b13-92db-b16cc4e94428" released by "delete_volume" :: held 2.479s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Created reservations ['a259023f-1880-4eb4-b5df-dee2b495ca70', '1b26f09d-7f0a-44f7-b6d3-3640f2931a05', '3f85a92e-7704-40c7-9826-d65e78f00aa3', '75773f78-0fa0-455c-b1aa-9c53b6da0931'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:58 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:13:58 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:58 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4" returned: 0 in 1.005s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.332s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f959fad-d117-41fc-90ff-6198111a0e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a012af56-3c25-40d0-a83a-0878187ce2a4', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39b5d50-872a-41d5-91d0-c2e3d291e96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:58 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Volume volume-a012af56-3c25-40d0-a83a-0878187ce2a4 (a012af56-3c25-40d0-a83a-0878187ce2a4): created successfully Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39b5d50-872a-41d5-91d0-c2e3d291e96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Flow 'volume_create_manager' (b2b1ba4c-a009-4d97-8b8f-fc95859e2127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:59 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-a5458add-2be0-4b27-a439-a63c419ff4cb req-2401e4c3-0597-4a32-ad88-01041cbd480a tempest-VolumesSnapshotsTestJSON-1861880390 None] Created volume successfully. Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Acquiring lock "cinder-7641704c-96af-4799-9fed-0024ed498d93-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Lock "cinder-7641704c-96af-4799-9fed-0024ed498d93-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Acquiring lock "cinder-quobyte-7641704c-96af-4799-9fed-0024ed498d93" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Lock "cinder-quobyte-7641704c-96af-4799-9fed-0024ed498d93" acquired by "delete_volume" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:13:59 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.134s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[10103bd7-7c0f-494d-b555-9701d3d184cd]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7641704c-96af-4799-9fed-0024ed498d93 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:59 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Deleted volume successfully. Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e50ef738-a67f-4961-b78a-6d984762cf45 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-a0ccc894-b8f9-4b13-92db-b16cc4e94428-delete_volume" released by "delete_volume" :: held 3.976s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:13:59 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7641704c-96af-4799-9fed-0024ed498d93 Jun 25 18:13:59 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Flow 'volume_create_manager' (a7b29105-98cd-48c9-a37c-f4e8a9a77b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0390f0-6d94-4dc6-b654-6db83223a68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0390f0-6d94-4dc6-b654-6db83223a68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-230472438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94f9257-6bd6-41e3-9950-9567336c35c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b144e84ab24b99b916f2f990f05d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:00Z,use_quota=True,user_id='f9470720f8204ae7858067ddd3a72705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b4ce69-bb43-42b9-bfdc-6c7e02e74b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b4ce69-bb43-42b9-bfdc-6c7e02e74b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d0d9c1-bbdc-48ca-9b68-5e36ed137f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d0d9c1-bbdc-48ca-9b68-5e36ed137f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f94f9257-6bd6-41e3-9950-9567336c35c8', 'volume_name': 'volume-f94f9257-6bd6-41e3-9950-9567336c35c8', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a907f2-773c-440b-86b5-7149ebad0d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a907f2-773c-440b-86b5-7149ebad0d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c082a2da-f489-4194-ab97-ac28003671de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:13:59 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Volume f94f9257-6bd6-41e3-9950-9567336c35c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f94f9257-6bd6-41e3-9950-9567336c35c8', 'volume_size': 1} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-230472438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94f9257-6bd6-41e3-9950-9567336c35c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b144e84ab24b99b916f2f990f05d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:00Z,use_quota=True,user_id='f9470720f8204ae7858067ddd3a72705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Creating volume f94f9257-6bd6-41e3-9950-9567336c35c8 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:13:59 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:13:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f94f9257-6bd6-41e3-9950-9567336c35c8 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:13:59 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f94f9257-6bd6-41e3-9950-9567336c35c8 1073741824 Jun 25 18:13:59 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:00 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7641704c-96af-4799-9fed-0024ed498d93" returned: 0 in 1.103s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7641704c-96af-4799-9fed-0024ed498d93 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:00 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7641704c-96af-4799-9fed-0024ed498d93 Jun 25 18:14:00 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:00 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f94f9257-6bd6-41e3-9950-9567336c35c8 1073741824" returned: 0 in 0.929s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f94f9257-6bd6-41e3-9950-9567336c35c8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:00 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f94f9257-6bd6-41e3-9950-9567336c35c8 Jun 25 18:14:00 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:01 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7641704c-96af-4799-9fed-0024ed498d93" returned: 0 in 0.738s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Lock "cinder-quobyte-7641704c-96af-4799-9fed-0024ed498d93" released by "delete_volume" :: held 1.920s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Created reservations ['460d107e-6b7f-4de2-b4bf-6115501c6b4f', 'f59b0c22-48e0-4d3f-9fef-2bce56688c80', 'd8a56679-e8cf-4292-a6d4-23d87a1da090', '3160ae1b-c53b-4d1f-b8c6-0f51d68ad0ba'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:01 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:14:01 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:01 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f94f9257-6bd6-41e3-9950-9567336c35c8" returned: 0 in 0.721s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.620s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] Creating offline snapshot ddc3db4f-62fa-4645-a826-d4d271276b2b of volume a012af56-3c25-40d0-a83a-0878187ce2a4 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c082a2da-f489-4194-ab97-ac28003671de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f94f9257-6bd6-41e3-9950-9567336c35c8', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a11adb6-f1a7-4afe-bced-a3265b22fcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb73993-6198-41ee-9078-c9815007be23]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:01 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Volume volume-f94f9257-6bd6-41e3-9950-9567336c35c8 (f94f9257-6bd6-41e3-9950-9567336c35c8): created successfully Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a11adb6-f1a7-4afe-bced-a3265b22fcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Flow 'volume_create_manager' (a7b29105-98cd-48c9-a37c-f4e8a9a77b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:01 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-dc905312-b233-465d-97fe-3a9e1c427700 tempest-VolumesActionsTest-1135227393 None] Created volume successfully. Jun 25 18:14:01 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4 Jun 25 18:14:01 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:02 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.897s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:02 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:02 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Deleted volume successfully. Jun 25 18:14:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fb3ca00f-5e08-44e7-9202-1aae2193d321 tempest-VolumeQuotasNegativeTestJSON-1340132084 None] Lock "cinder-7641704c-96af-4799-9fed-0024ed498d93-delete_volume" released by "delete_volume" :: held 3.127s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:02 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4" returned: 0 in 1.027s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:02 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b 1G Jun 25 18:14:02 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Acquiring lock "cinder-f94f9257-6bd6-41e3-9950-9567336c35c8-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-f94f9257-6bd6-41e3-9950-9567336c35c8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Acquiring lock "cinder-quobyte-f94f9257-6bd6-41e3-9950-9567336c35c8" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-quobyte-f94f9257-6bd6-41e3-9950-9567336c35c8" acquired by "delete_volume" :: waited 0.018s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:03 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[a450497d-8255-4ae4-b5ff-f645f69ef23b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f94f9257-6bd6-41e3-9950-9567336c35c8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:03 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f94f9257-6bd6-41e3-9950-9567336c35c8 Jun 25 18:14:03 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:04 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b 1G" returned: 0 in 1.267s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a012af56-3c25-40d0-a83a-0878187ce2a4 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:04 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a012af56-3c25-40d0-a83a-0878187ce2a4 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b Jun 25 18:14:04 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:04 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f94f9257-6bd6-41e3-9950-9567336c35c8" returned: 0 in 1.263s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f94f9257-6bd6-41e3-9950-9567336c35c8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:04 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f94f9257-6bd6-41e3-9950-9567336c35c8 Jun 25 18:14:04 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:05 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a012af56-3c25-40d0-a83a-0878187ce2a4 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b" returned: 0 in 1.127s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:05 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b is being set with open permissions: ugo+rw Jun 25 18:14:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:05 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b Jun 25 18:14:05 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:05 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f94f9257-6bd6-41e3-9950-9567336c35c8" returned: 0 in 1.120s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-quobyte-f94f9257-6bd6-41e3-9950-9567336c35c8" released by "delete_volume" :: held 2.468s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:05 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Created reservations ['f8523693-792d-4ba3-93c3-de5b09463bb1', '4cf80557-d1d5-4fea-9863-c9b9b1d719b4', '83498014-7266-4668-a8c1-2e5037a62953', '010abc05-857d-4c47-8dff-0ae37e5980cd'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:05 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:14:05 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:06 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b" returned: 0 in 1.010s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:06 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.info Jun 25 18:14:06 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:06 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.930s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:06 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:06 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Deleted volume successfully. Jun 25 18:14:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b5a833d2-5976-491b-a50d-289b55608895 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-f94f9257-6bd6-41e3-9950-9567336c35c8-delete_volume" released by "delete_volume" :: held 3.791s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:07 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.info" returned: 0 in 0.887s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:07 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.info is being set with open permissions: ugo+rw Jun 25 18:14:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:07 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.info Jun 25 18:14:07 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:07 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Flow 'volume_create_manager' (ae754ae0-9334-474b-81d1-3f0f007e89ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3409f057-9174-47bb-b64f-01d0ad26f279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3409f057-9174-47bb-b64f-01d0ad26f279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-985333590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10dacc74-34ce-4bbc-a764-b040081f25c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b144e84ab24b99b916f2f990f05d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:08Z,use_quota=True,user_id='f9470720f8204ae7858067ddd3a72705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49803d37-54fe-4226-9f50-dc8d09459be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49803d37-54fe-4226-9f50-dc8d09459be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a39e5ec-ff5e-47cc-89a9-77d80fa8a89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a39e5ec-ff5e-47cc-89a9-77d80fa8a89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10dacc74-34ce-4bbc-a764-b040081f25c0', 'volume_name': 'volume-10dacc74-34ce-4bbc-a764-b040081f25c0', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dae94e8-76cb-496b-87aa-3f8bb30ede2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dae94e8-76cb-496b-87aa-3f8bb30ede2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad615c17-befc-44e3-8d86-45e8f7791ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:07 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Volume 10dacc74-34ce-4bbc-a764-b040081f25c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10dacc74-34ce-4bbc-a764-b040081f25c0', 'volume_size': 1} Jun 25 18:14:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:08 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.info" returned: 0 in 0.996s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.492s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.394s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-985333590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10dacc74-34ce-4bbc-a764-b040081f25c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b144e84ab24b99b916f2f990f05d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:08Z,use_quota=True,user_id='f9470720f8204ae7858067ddd3a72705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Creating volume 10dacc74-34ce-4bbc-a764-b040081f25c0 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:08 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:14:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-10dacc74-34ce-4bbc-a764-b040081f25c0 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:08 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-10dacc74-34ce-4bbc-a764-b040081f25c0 1073741824 Jun 25 18:14:08 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:08 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-01d09348-1f9b-410d-800b-85589ad0742c req-a3f7cb47-ba34-4b4b-9287-b1987847127f tempest-VolumesSnapshotsTestJSON-1861880390 None] Create snapshot completed successfully Jun 25 18:14:09 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Acquiring lock "cinder-ddc3db4f-62fa-4645-a826-d4d271276b2b-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-10dacc74-34ce-4bbc-a764-b040081f25c0 1073741824" returned: 0 in 1.017s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "cinder-ddc3db4f-62fa-4645-a826-d4d271276b2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Acquiring lock "cinder-quobyte-a012af56-3c25-40d0-a83a-0878187ce2a4" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "cinder-quobyte-a012af56-3c25-40d0-a83a-0878187ce2a4" acquired by "delete_snapshot" :: waited 0.046s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Acquiring lock "cinder-quobyte-ddc3db4f-62fa-4645-a826-d4d271276b2b" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-10dacc74-34ce-4bbc-a764-b040081f25c0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "cinder-quobyte-ddc3db4f-62fa-4645-a826-d4d271276b2b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:09 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-10dacc74-34ce-4bbc-a764-b040081f25c0 Jun 25 18:14:09 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Deleting offline snapshot ddc3db4f-62fa-4645-a826-d4d271276b2b of volume a012af56-3c25-40d0-a83a-0878187ce2a4 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] snapshot_file for this snap is: volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57a3440-7d67-445b-988c-cd16f0416b79]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:09 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b Jun 25 18:14:09 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Flow 'volume_create_manager' (a18d082a-b0df-430b-8a76-c7aaf00d507b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d96753-2361-44d8-a513-636a6f9a0e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d96753-2361-44d8-a513-636a6f9a0e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1976577738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3580dae-4101-4ffb-ac76-fac5b8d3f052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09667280fddc4edea86fd8557614cd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:10Z,use_quota=True,user_id='b05d9c25cded47119352c7e57d3a342a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cdd2fe5-a5b9-4bce-8931-eb97cb69913d),volume_type_id=8cdd2fe5-a5b9-4bce-8931-eb97cb69913d)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b21a87-c8d9-483c-b554-9029ecbed452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b21a87-c8d9-483c-b554-9029ecbed452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74556e03-103a-4c1c-8d09-5a9f787e1c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74556e03-103a-4c1c-8d09-5a9f787e1c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3580dae-4101-4ffb-ac76-fac5b8d3f052', 'volume_name': 'volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bd4afd-4c7d-4919-92b4-b663d7bb2204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bd4afd-4c7d-4919-92b4-b663d7bb2204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ea5228-a2b0-4d98-a95c-1c7957d3ee52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:09 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Volume b3580dae-4101-4ffb-ac76-fac5b8d3f052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052', 'volume_size': 1} Jun 25 18:14:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:10 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-10dacc74-34ce-4bbc-a764-b040081f25c0" returned: 0 in 0.827s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.161s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1976577738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3580dae-4101-4ffb-ac76-fac5b8d3f052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09667280fddc4edea86fd8557614cd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:10Z,use_quota=True,user_id='b05d9c25cded47119352c7e57d3a342a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cdd2fe5-a5b9-4bce-8931-eb97cb69913d),volume_type_id=8cdd2fe5-a5b9-4bce-8931-eb97cb69913d)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Creating volume b3580dae-4101-4ffb-ac76-fac5b8d3f052 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:10 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:10 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052 1073741824 Jun 25 18:14:10 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad615c17-befc-44e3-8d86-45e8f7791ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10dacc74-34ce-4bbc-a764-b040081f25c0', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af608d75-ebf7-4540-b3b9-2ca0e7a9d590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:10 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Volume volume-10dacc74-34ce-4bbc-a764-b040081f25c0 (10dacc74-34ce-4bbc-a764-b040081f25c0): created successfully Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af608d75-ebf7-4540-b3b9-2ca0e7a9d590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Flow 'volume_create_manager' (ae754ae0-9334-474b-81d1-3f0f007e89ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-fdcd5770-b650-4a37-9631-f8187ff7a421 tempest-VolumesActionsTest-1135227393 None] Created volume successfully. Jun 25 18:14:10 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b" returned: 0 in 0.974s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a012af56-3c25-40d0-a83a-0878187ce2a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e4e00e-4b0a-44df-90c6-16c577858ec8]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:10 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4 Jun 25 18:14:10 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Acquiring lock "cinder-10dacc74-34ce-4bbc-a764-b040081f25c0-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-10dacc74-34ce-4bbc-a764-b040081f25c0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Acquiring lock "cinder-quobyte-10dacc74-34ce-4bbc-a764-b040081f25c0" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-quobyte-10dacc74-34ce-4bbc-a764-b040081f25c0" acquired by "delete_volume" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:11 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052 1073741824" returned: 0 in 0.925s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3ed6c7-caf0-4557-bdc5-5596462e4b75]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-10dacc74-34ce-4bbc-a764-b040081f25c0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:11 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052 Jun 25 18:14:11 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:11 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-10dacc74-34ce-4bbc-a764-b040081f25c0 Jun 25 18:14:11 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:11 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4" returned: 0 in 0.820s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:11 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b Jun 25 18:14:11 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:11 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:11 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-10dacc74-34ce-4bbc-a764-b040081f25c0" returned: 0 in 0.805s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-10dacc74-34ce-4bbc-a764-b040081f25c0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052" returned: 0 in 0.770s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:11 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-10dacc74-34ce-4bbc-a764-b040081f25c0 Jun 25 18:14:11 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ea5228-a2b0-4d98-a95c-1c7957d3ee52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daca9a57-07aa-445f-b032-3c6e435ceaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:11 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Volume volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052 (b3580dae-4101-4ffb-ac76-fac5b8d3f052): created successfully Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daca9a57-07aa-445f-b032-3c6e435ceaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Flow 'volume_create_manager' (a18d082a-b0df-430b-8a76-c7aaf00d507b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:11 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-46a0a4e6-6a37-4655-80cc-70e9335cb37f tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Created volume successfully. Jun 25 18:14:11 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b" returned: 0 in 0.807s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:12 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b Jun 25 18:14:12 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:12 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-10dacc74-34ce-4bbc-a764-b040081f25c0" returned: 0 in 0.661s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:12 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-quobyte-10dacc74-34ce-4bbc-a764-b040081f25c0" released by "delete_volume" :: held 1.536s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:12 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Created reservations ['123ea49f-8119-4f21-b382-60d64bac8eb6', '6eceaba9-bf78-464a-b997-a134abc7e232', 'eb94e651-4625-425f-a8fb-dfecfe47b48b', '976a5641-e9f6-4dba-9c45-b0075f4fd05a'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:12 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:14:12 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:12 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4.ddc3db4f-62fa-4645-a826-d4d271276b2b" returned: 0 in 0.771s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:12 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "cinder-quobyte-ddc3db4f-62fa-4645-a826-d4d271276b2b" released by "_delete_snapshot" :: held 3.521s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:12 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "cinder-quobyte-a012af56-3c25-40d0-a83a-0878187ce2a4" released by "delete_snapshot" :: held 3.569s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:12 devstack cinder-volume[93651]: DEBUG cinder.quota [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Created reservations ['4047e9df-b6c7-48a3-b634-1be8cacd70e1', '9849e6b6-8607-4dce-b5d4-3917a147a240', '0a65835b-01e7-4361-bf70-d55a3b8664f2', '9fb9b26e-c22d-4ef8-89c0-e52a8b3899a7'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:13 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Delete snapshot completed successfully. Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-46c0d203-019b-46b2-b878-2aba76155452 req-03beb8de-d1ce-4cea-8726-a733bf627ffd tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "cinder-ddc3db4f-62fa-4645-a826-d4d271276b2b-delete_snapshot" released by "delete_snapshot" :: held 3.846s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-36f12a97-24b8-45a6-9c4e-1e5c2e3474d6 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-36f12a97-24b8-45a6-9c4e-1e5c2e3474d6 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-36f12a97-24b8-45a6-9c4e-1e5c2e3474d6 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-36f12a97-24b8-45a6-9c4e-1e5c2e3474d6 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-36f12a97-24b8-45a6-9c4e-1e5c2e3474d6 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-36f12a97-24b8-45a6-9c4e-1e5c2e3474d6 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:13 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:14:13 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Acquiring lock "cinder-a012af56-3c25-40d0-a83a-0878187ce2a4-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:13 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.929s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:13 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Deleted volume successfully. Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "cinder-a012af56-3c25-40d0-a83a-0878187ce2a4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d545a833-4599-4118-a108-ff8338ea3ef4 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-10dacc74-34ce-4bbc-a764-b040081f25c0-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Acquiring lock "cinder-quobyte-a012af56-3c25-40d0-a83a-0878187ce2a4" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "cinder-quobyte-a012af56-3c25-40d0-a83a-0878187ce2a4" acquired by "delete_volume" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcc5b74-9f66-4106-81fa-f461e80593e6]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Flow 'volume_create_manager' (ef94bcc7-b404-4ca6-b9f7-357712eb3731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:13 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4 Jun 25 18:14:13 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe746167-713b-457f-b9b9-3c1671cce803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe746167-713b-457f-b9b9-3c1671cce803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2041425454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69852710-cd2d-4fb2-acde-1d52b1eecfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b144e84ab24b99b916f2f990f05d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:14Z,use_quota=True,user_id='f9470720f8204ae7858067ddd3a72705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19dff116-daf1-4f48-9267-0f0e506fdb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19dff116-daf1-4f48-9267-0f0e506fdb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe701367-235c-411f-b5ce-af1b019be09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe701367-235c-411f-b5ce-af1b019be09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69852710-cd2d-4fb2-acde-1d52b1eecfb5', 'volume_name': 'volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (616cfe45-ac11-4ddf-9239-e97e96978fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (616cfe45-ac11-4ddf-9239-e97e96978fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d73a92-ee01-4e45-bf13-558323a75541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:14 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Volume 69852710-cd2d-4fb2-acde-1d52b1eecfb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5', 'volume_size': 1} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2041425454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69852710-cd2d-4fb2-acde-1d52b1eecfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b144e84ab24b99b916f2f990f05d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:14Z,use_quota=True,user_id='f9470720f8204ae7858067ddd3a72705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Creating volume 69852710-cd2d-4fb2-acde-1d52b1eecfb5 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:14 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:14 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5 1073741824 Jun 25 18:14:14 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:14 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-36f12a97-24b8-45a6-9c4e-1e5c2e3474d6 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.842s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-36f12a97-24b8-45a6-9c4e-1e5c2e3474d6 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:14 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-36f12a97-24b8-45a6-9c4e-1e5c2e3474d6 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Retype volume completed successfully. Jun 25 18:14:14 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Acquiring lock "cinder-b3580dae-4101-4ffb-ac76-fac5b8d3f052-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4" returned: 0 in 0.851s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:14 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4 Jun 25 18:14:14 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Lock "cinder-b3580dae-4101-4ffb-ac76-fac5b8d3f052-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Acquiring lock "cinder-quobyte-b3580dae-4101-4ffb-ac76-fac5b8d3f052" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Lock "cinder-quobyte-b3580dae-4101-4ffb-ac76-fac5b8d3f052" acquired by "delete_volume" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b6d5a0-7bb5-412a-98d1-d83041c2ab5e]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:14 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052 Jun 25 18:14:14 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:15 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5 1073741824" returned: 0 in 1.001s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:15 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5 Jun 25 18:14:15 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:15 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a012af56-3c25-40d0-a83a-0878187ce2a4" returned: 0 in 0.813s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "cinder-quobyte-a012af56-3c25-40d0-a83a-0878187ce2a4" released by "delete_volume" :: held 1.732s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG cinder.quota [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Created reservations ['f740671d-7c5e-41ed-a590-b714596aef9a', '1bfd85d2-ebe1-44e1-86c8-38c7c8a46163', 'ffde3f6c-e57e-4492-ace5-8c467116261b', 'bd3a5e09-09f9-4909-bf4d-9a4ba90b675d'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:15 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:14:15 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:15 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052" returned: 0 in 0.929s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:15 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052 Jun 25 18:14:15 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:15 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5" returned: 0 in 0.769s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d73a92-ee01-4e45-bf13-558323a75541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd53b64-afba-44c3-9d73-04cb5f90fce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:15 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Volume volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5 (69852710-cd2d-4fb2-acde-1d52b1eecfb5): created successfully Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd53b64-afba-44c3-9d73-04cb5f90fce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Flow 'volume_create_manager' (ef94bcc7-b404-4ca6-b9f7-357712eb3731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:15 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-70f5ab9f-c2e5-4d83-af31-dc313f399c9f tempest-VolumesActionsTest-1135227393 None] Created volume successfully. Jun 25 18:14:16 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.825s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:16 devstack cinder-volume[93651]: DEBUG cinder.manager [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:16 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Deleted volume successfully. Jun 25 18:14:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-b8e1bb90-d987-42a6-86ef-e64a62cc0566 req-5773d94e-a019-442a-b5ab-2fe4f6b8e6e8 tempest-VolumesSnapshotsTestJSON-1861880390 None] Lock "cinder-a012af56-3c25-40d0-a83a-0878187ce2a4-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:16 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b3580dae-4101-4ffb-ac76-fac5b8d3f052" returned: 0 in 0.842s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Lock "cinder-quobyte-b3580dae-4101-4ffb-ac76-fac5b8d3f052" released by "delete_volume" :: held 1.828s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:16 devstack cinder-volume[93651]: WARNING cinder.quota [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:14:16 devstack cinder-volume[93651]: WARNING cinder.quota [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:14:16 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Created reservations ['04b912d7-4df1-4d41-9aac-6991753df4a0', '7151a2d0-b2d8-4d67-85eb-06cf879d4d52', 'c2651981-8f69-4930-9a37-7796862aaef0', '5d880065-4557-4340-b5de-49d370af481f'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:16 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:14:16 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Acquiring lock "cinder-69852710-cd2d-4fb2-acde-1d52b1eecfb5-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-69852710-cd2d-4fb2-acde-1d52b1eecfb5-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Acquiring lock "cinder-quobyte-69852710-cd2d-4fb2-acde-1d52b1eecfb5" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-quobyte-69852710-cd2d-4fb2-acde-1d52b1eecfb5" acquired by "delete_volume" :: waited 0.038s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:17 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[375d256a-eaef-455a-9acc-4fbb7bfeba4a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:17 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.013s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:17 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:17 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Deleted volume successfully. Jun 25 18:14:17 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5 Jun 25 18:14:17 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6801cd62-316e-4c42-a8d2-6f2b1b5265c9 tempest-VolumeRetypeWithoutMigrationTest-298823565 None] Lock "cinder-b3580dae-4101-4ffb-ac76-fac5b8d3f052-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:18 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5" returned: 0 in 1.129s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:18 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5 Jun 25 18:14:18 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:19 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-69852710-cd2d-4fb2-acde-1d52b1eecfb5" returned: 0 in 1.157s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-quobyte-69852710-cd2d-4fb2-acde-1d52b1eecfb5" released by "delete_volume" :: held 2.392s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:20 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Created reservations ['0a046fab-b831-48b2-8554-1e73fd7582bf', 'd761cfc2-8a9f-4592-8288-f29fc1f51aca', '2d2f9227-46e6-459a-8fb9-359da2eb68a1', '5c928b3e-975f-49cd-aeee-75513f130201'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:20 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:14:20 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:21 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.215s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:21 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:21 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Deleted volume successfully. Jun 25 18:14:21 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d4f99fbc-08e6-4624-be1b-a350d63ae2d5 tempest-VolumesActionsTest-1239401262 None] Lock "cinder-69852710-cd2d-4fb2-acde-1d52b1eecfb5-delete_volume" released by "delete_volume" :: held 4.125s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:21 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Flow 'volume_create_manager' (e27128ec-3543-4a32-bfd8-db2ad6938814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75a6c8a-4101-4a16-94b0-365abddbb7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75a6c8a-4101-4a16-94b0-365abddbb7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-109116215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72375cdf-6ef7-4f78-b1b2-ab282d785e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b144e84ab24b99b916f2f990f05d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:22Z,use_quota=True,user_id='f9470720f8204ae7858067ddd3a72705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e79a9bc-7934-4dce-9582-e5e54c5e06cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e79a9bc-7934-4dce-9582-e5e54c5e06cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12805600-eb93-4a06-9215-6dc153d39b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12805600-eb93-4a06-9215-6dc153d39b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72375cdf-6ef7-4f78-b1b2-ab282d785e92', 'volume_name': 'volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930257fc-94da-4084-acb0-48f81c69eb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930257fc-94da-4084-acb0-48f81c69eb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa32f98-025b-4c1b-895f-3d642a89faf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:22 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Volume 72375cdf-6ef7-4f78-b1b2-ab282d785e92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92', 'volume_size': 1} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-109116215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72375cdf-6ef7-4f78-b1b2-ab282d785e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b144e84ab24b99b916f2f990f05d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:22Z,use_quota=True,user_id='f9470720f8204ae7858067ddd3a72705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Creating volume 72375cdf-6ef7-4f78-b1b2-ab282d785e92 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:22 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:14:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:22 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92 1073741824 Jun 25 18:14:22 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:23 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92 1073741824" returned: 0 in 1.481s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:23 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92 Jun 25 18:14:23 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:24 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92" returned: 0 in 0.838s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] <== create_volume: return (2412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.415s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa32f98-025b-4c1b-895f-3d642a89faf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1480b35b-3e4d-4f62-a5c6-306b73cba7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:24 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Volume volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92 (72375cdf-6ef7-4f78-b1b2-ab282d785e92): created successfully Jun 25 18:14:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1480b35b-3e4d-4f62-a5c6-306b73cba7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Flow 'volume_create_manager' (e27128ec-3543-4a32-bfd8-db2ad6938814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:24 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-170f4b4e-8178-443d-9cfd-6b23d658ec96 tempest-VolumesActionsTest-1135227393 None] Created volume successfully. Jun 25 18:14:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-312fafed-aea3-4fe3-bd9f-90347c0aba60 tempest-BackendsCapabilitiesAdminTestsJSON-130047646 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6810264587402, 'free_capacity_gb': 1775.6810264587402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93651) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:5185}} Jun 25 18:14:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-47544180-36a8-4ec0-923e-783224d1f8d9 tempest-BackendsCapabilitiesAdminTestsJSON-130047646 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6810264587402, 'free_capacity_gb': 1775.6810264587402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93651) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:5185}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Flow 'volume_create_manager' (81f22e73-e48c-4efe-9950-0db1273f3148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebacff39-60f3-4b9c-9820-78580e97f2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebacff39-60f3-4b9c-9820-78580e97f2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2035257572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51707bfb-a3ca-4723-b4bb-db1db6724e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed9e84d69a8c425abfc912b541e00921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:26Z,use_quota=True,user_id='eb9f8edb080141d7ae59d319c83d9ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a76b726-6e50-49b9-965e-dc3a6fc2651a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a76b726-6e50-49b9-965e-dc3a6fc2651a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06afbdb5-1b1f-4592-a7a0-7149caf3fa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06afbdb5-1b1f-4592-a7a0-7149caf3fa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51707bfb-a3ca-4723-b4bb-db1db6724e02', 'volume_name': 'volume-51707bfb-a3ca-4723-b4bb-db1db6724e02', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0460a662-e101-46dd-a838-3bf777406f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0460a662-e101-46dd-a838-3bf777406f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fe6d1e-6737-4502-81d6-2df90ecdb5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:26 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Volume 51707bfb-a3ca-4723-b4bb-db1db6724e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51707bfb-a3ca-4723-b4bb-db1db6724e02', 'volume_size': 1} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2035257572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51707bfb-a3ca-4723-b4bb-db1db6724e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed9e84d69a8c425abfc912b541e00921',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:26Z,use_quota=True,user_id='eb9f8edb080141d7ae59d319c83d9ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Creating volume 51707bfb-a3ca-4723-b4bb-db1db6724e02 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:26 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-51707bfb-a3ca-4723-b4bb-db1db6724e02 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:26 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-51707bfb-a3ca-4723-b4bb-db1db6724e02 1073741824 Jun 25 18:14:26 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Acquiring lock "cinder-72375cdf-6ef7-4f78-b1b2-ab282d785e92-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Lock "cinder-72375cdf-6ef7-4f78-b1b2-ab282d785e92-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Acquiring lock "cinder-quobyte-72375cdf-6ef7-4f78-b1b2-ab282d785e92" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Lock "cinder-quobyte-72375cdf-6ef7-4f78-b1b2-ab282d785e92" acquired by "delete_volume" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e7f203-e10a-49ce-b833-75103494059d]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:26 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92 Jun 25 18:14:26 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:27 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-51707bfb-a3ca-4723-b4bb-db1db6724e02 1073741824" returned: 0 in 1.202s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-51707bfb-a3ca-4723-b4bb-db1db6724e02 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:27 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-51707bfb-a3ca-4723-b4bb-db1db6724e02 Jun 25 18:14:27 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:27 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92" returned: 0 in 1.095s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:27 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92 Jun 25 18:14:27 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:28 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-51707bfb-a3ca-4723-b4bb-db1db6724e02" returned: 0 in 0.871s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.128s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fe6d1e-6737-4502-81d6-2df90ecdb5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51707bfb-a3ca-4723-b4bb-db1db6724e02', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7537546f-2f2c-46e0-ae7c-f9472a894227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:28 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Volume volume-51707bfb-a3ca-4723-b4bb-db1db6724e02 (51707bfb-a3ca-4723-b4bb-db1db6724e02): created successfully Jun 25 18:14:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7537546f-2f2c-46e0-ae7c-f9472a894227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Flow 'volume_create_manager' (81f22e73-e48c-4efe-9950-0db1273f3148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:28 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-43db6f4a-272a-4f9b-b225-abba67fd2601 tempest-VolumesServicesTestJSON-1036368703 None] Created volume successfully. Jun 25 18:14:28 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72375cdf-6ef7-4f78-b1b2-ab282d785e92" returned: 0 in 1.068s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Lock "cinder-quobyte-72375cdf-6ef7-4f78-b1b2-ab282d785e92" released by "delete_volume" :: held 2.221s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:29 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Created reservations ['da1dbc06-dc44-4998-842a-af0cdb36e891', '73f95413-64ea-4d5c-bc1c-9ec9bc9daf85', 'd656523b-b8c9-4af2-843f-ac230448f837', '6de4b383-a780-4f8a-82c1-6c6b62713211'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:29 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:14:29 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Acquiring lock "cinder-51707bfb-a3ca-4723-b4bb-db1db6724e02-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Lock "cinder-51707bfb-a3ca-4723-b4bb-db1db6724e02-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Acquiring lock "cinder-quobyte-51707bfb-a3ca-4723-b4bb-db1db6724e02" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:14:30 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Lock "cinder-quobyte-51707bfb-a3ca-4723-b4bb-db1db6724e02" acquired by "delete_volume" :: waited 0.034s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:14:30 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d03939e-f68b-47a5-9953-e4e5bea871c5]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-51707bfb-a3ca-4723-b4bb-db1db6724e02 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:30 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-51707bfb-a3ca-4723-b4bb-db1db6724e02 Jun 25 18:14:30 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:30 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.144s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:30 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:30 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Deleted volume successfully. Jun 25 18:14:30 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-19e0fc76-8801-49c4-8ce5-d534e3739743 tempest-VolumesActionsTest-1135227393 None] Lock "cinder-72375cdf-6ef7-4f78-b1b2-ab282d785e92-delete_volume" released by "delete_volume" :: held 3.771s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:31 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-51707bfb-a3ca-4723-b4bb-db1db6724e02" returned: 0 in 1.165s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-51707bfb-a3ca-4723-b4bb-db1db6724e02 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:31 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-51707bfb-a3ca-4723-b4bb-db1db6724e02 Jun 25 18:14:31 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:32 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-51707bfb-a3ca-4723-b4bb-db1db6724e02" returned: 0 in 0.944s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Lock "cinder-quobyte-51707bfb-a3ca-4723-b4bb-db1db6724e02" released by "delete_volume" :: held 2.203s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:32 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Created reservations ['23de3e96-e2ce-4ef9-ba24-a45450784559', '62025039-a0c3-495b-8440-857287fb962b', 'da80c378-2316-434b-be64-2bf2f81e323d', '59b99cb1-5e72-48b6-8de4-b040038d57b2'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:14:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:32 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:14:32 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:33 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.901s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:33 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:33 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Deleted volume successfully. Jun 25 18:14:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-80301139-17dc-489a-8247-0979ed10f155 tempest-VolumesServicesTestJSON-1036368703 None] Lock "cinder-51707bfb-a3ca-4723-b4bb-db1db6724e02-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:14:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:14:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:39 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:14:39 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:40 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.321s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:14:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:14:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 8 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:14:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:14:42 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=82,cinder:UPDATE=117,cinder:DELETE=11,cinder:INSERT=24 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:14:43 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=76,cinder:UPDATE=104,cinder:INSERT=26,cinder:DELETE=8 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Flow 'volume_create_manager' (781c15f5-d41f-4770-a6e0-4d5cbffeb02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae47d99-e9db-431f-aa9c-135852ff2d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae47d99-e9db-431f-aa9c-135852ff2d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1539450562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a631bb09-2e1a-4b15-9a36-a5d8b7860e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d72d55c52f142559c38de1683b705a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:47Z,use_quota=True,user_id='8ea6f8c4130e441785382fbb400493c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e71708-b5fe-4c9c-a21e-194e9097924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e71708-b5fe-4c9c-a21e-194e9097924c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54af1e30-2988-4a52-b340-172d558c8b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54af1e30-2988-4a52-b340-172d558c8b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a631bb09-2e1a-4b15-9a36-a5d8b7860e5c', 'volume_name': 'volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b612de-0ff1-489c-8903-4d2646358afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b612de-0ff1-489c-8903-4d2646358afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8423339-3be7-40d4-90d9-5f1934b87ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:47 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Volume a631bb09-2e1a-4b15-9a36-a5d8b7860e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c', 'volume_size': 1} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1539450562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a631bb09-2e1a-4b15-9a36-a5d8b7860e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d72d55c52f142559c38de1683b705a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:47Z,use_quota=True,user_id='8ea6f8c4130e441785382fbb400493c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Creating volume a631bb09-2e1a-4b15-9a36-a5d8b7860e5c {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:47 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:14:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:47 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c 1073741824 Jun 25 18:14:47 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:48 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c 1073741824" returned: 0 in 1.094s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:48 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c Jun 25 18:14:48 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:49 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c" returned: 0 in 0.959s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.113s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8423339-3be7-40d4-90d9-5f1934b87ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab452d3-7b01-43c0-9702-dddc438bc6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:49 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Volume volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c (a631bb09-2e1a-4b15-9a36-a5d8b7860e5c): created successfully Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab452d3-7b01-43c0-9702-dddc438bc6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Flow 'volume_create_manager' (781c15f5-d41f-4770-a6e0-4d5cbffeb02c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:49 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-9f8aa9dc-08c9-4a3d-9b33-3b1acf3e5ff2 tempest-SnapshotMetadataTestJSON-1070711520 None] Created volume successfully. Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Flow 'volume_create_manager' (44f6e3ec-8c27-47eb-a792-1b0d30b74696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f1d84a-a8d7-4627-b4b8-40ca66381b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f1d84a-a8d7-4627-b4b8-40ca66381b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-464952811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c161f35-d4a8-46aa-a77f-45c66e343dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13af9f0694d49c1aff89140c64ddcc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:49Z,use_quota=True,user_id='0accb1f70cb94265ba6cb0707ccf228a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae74c2f8-a4fd-4909-85b8-ba08fe38b1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae74c2f8-a4fd-4909-85b8-ba08fe38b1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725939e6-1313-45e1-ad80-eef74534ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725939e6-1313-45e1-ad80-eef74534ff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c161f35-d4a8-46aa-a77f-45c66e343dcf', 'volume_name': 'volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd1f0f9-9f83-40d2-a718-39afda3bcfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd1f0f9-9f83-40d2-a718-39afda3bcfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8c32c3-8935-4ba1-8d8a-9c08290f1dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:49 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Volume 7c161f35-d4a8-46aa-a77f-45c66e343dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf', 'volume_size': 1} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-464952811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c161f35-d4a8-46aa-a77f-45c66e343dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13af9f0694d49c1aff89140c64ddcc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:49Z,use_quota=True,user_id='0accb1f70cb94265ba6cb0707ccf228a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Creating volume 7c161f35-d4a8-46aa-a77f-45c66e343dcf {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:49 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:14:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:49 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf 1073741824 Jun 25 18:14:49 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:51 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf 1073741824" returned: 0 in 1.925s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:51 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf Jun 25 18:14:51 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:52 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf" returned: 0 in 0.773s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] <== create_volume: return (2755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:14:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.762s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.101s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8c32c3-8935-4ba1-8d8a-9c08290f1dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d52e28d-4650-4091-a1d5-8047f575a82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] Creating offline snapshot db9db8cc-6f06-4d77-8095-ce2b280b4f37 of volume a631bb09-2e1a-4b15-9a36-a5d8b7860e5c {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:14:52 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Volume volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf (7c161f35-d4a8-46aa-a77f-45c66e343dcf): created successfully Jun 25 18:14:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d52e28d-4650-4091-a1d5-8047f575a82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Flow 'volume_create_manager' (44f6e3ec-8c27-47eb-a792-1b0d30b74696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:52 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a79508-609f-4600-b322-54492a3d856c]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:14:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:52 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-bf811847-92ec-44a1-a13a-4620f4e2dff0 tempest-VolumesListAdminTestJSON-1038087879 None] Created volume successfully. Jun 25 18:14:52 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c Jun 25 18:14:52 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:53 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:14:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Flow 'volume_create_manager' (64af5c04-d27b-4728-b55b-6a5855417af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:14:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b37fd4f-c368-43cc-9c74-4df2be159e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:53 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b37fd4f-c368-43cc-9c74-4df2be159e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1604869102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44651829-94d1-4af0-9db4-840b3d6495c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13af9f0694d49c1aff89140c64ddcc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:54Z,use_quota=True,user_id='0accb1f70cb94265ba6cb0707ccf228a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9621eb9-1405-4a39-b0ff-81a069e1a867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9621eb9-1405-4a39-b0ff-81a069e1a867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8cd3205-5038-4f96-b222-13075d790262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8cd3205-5038-4f96-b222-13075d790262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44651829-94d1-4af0-9db4-840b3d6495c8', 'volume_name': 'volume-44651829-94d1-4af0-9db4-840b3d6495c8', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b685b009-66a3-4bff-bc4d-c156d63911e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b685b009-66a3-4bff-bc4d-c156d63911e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:14:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be2ae42-2e67-48f1-81a1-f297a84cf70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:14:54 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Volume 44651829-94d1-4af0-9db4-840b3d6495c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44651829-94d1-4af0-9db4-840b3d6495c8', 'volume_size': 1} Jun 25 18:14:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c" returned: 0 in 1.573s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:54 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 1G Jun 25 18:14:54 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:55 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 1G" returned: 0 in 1.464s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:55 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 Jun 25 18:14:55 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:56 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37" returned: 0 in 1.105s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:56 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 is being set with open permissions: ugo+rw Jun 25 18:14:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:56 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 Jun 25 18:14:56 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:57 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37" returned: 0 in 0.826s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:57 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.info Jun 25 18:14:57 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:58 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.info" returned: 0 in 0.886s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:58 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.info is being set with open permissions: ugo+rw Jun 25 18:14:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:58 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.info Jun 25 18:14:58 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:59 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Jun 25 18:14:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.info" returned: 0 in 0.727s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:14:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.785s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.093s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1604869102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44651829-94d1-4af0-9db4-840b3d6495c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13af9f0694d49c1aff89140c64ddcc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:14:54Z,use_quota=True,user_id='0accb1f70cb94265ba6cb0707ccf228a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:14:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Creating volume 44651829-94d1-4af0-9db4-840b3d6495c8 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:14:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:14:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:14:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:14:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:14:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:14:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:14:59 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:14:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-44651829-94d1-4af0-9db4-840b3d6495c8 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:14:59 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-44651829-94d1-4af0-9db4-840b3d6495c8 1073741824 Jun 25 18:14:59 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:14:59 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-9f4928c1-01ce-4a1c-a990-ded0821412d1 tempest-SnapshotMetadataTestJSON-1070711520 None] Create snapshot completed successfully Jun 25 18:15:00 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-44651829-94d1-4af0-9db4-840b3d6495c8 1073741824" returned: 0 in 1.111s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-44651829-94d1-4af0-9db4-840b3d6495c8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:00 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-44651829-94d1-4af0-9db4-840b3d6495c8 Jun 25 18:15:00 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:00 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Flow 'volume_create_manager' (03aef278-70b2-443c-921e-a440a8b4f71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a35aa05-6944-4c0c-85b4-e63011adc1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a35aa05-6944-4c0c-85b4-e63011adc1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1086756231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125860f7-95be-41a0-bc03-19b620360100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348d882307d043518a7ad9894278b2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:01Z,use_quota=True,user_id='69183ba8d8764c0eb678f0845311ba50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a33f8c54-d452-49ea-942a-d4f247a086a2),volume_type_id=a33f8c54-d452-49ea-942a-d4f247a086a2)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a94ed9-024e-4ed9-9c12-7ece8b05411e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a94ed9-024e-4ed9-9c12-7ece8b05411e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32076a87-6728-44fe-aba1-a8b1ffd1bbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32076a87-6728-44fe-aba1-a8b1ffd1bbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '125860f7-95be-41a0-bc03-19b620360100', 'volume_name': 'volume-125860f7-95be-41a0-bc03-19b620360100', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ffab74-cd1f-4bcc-a3d7-589a763c002e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ffab74-cd1f-4bcc-a3d7-589a763c002e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb7ebd8-25d3-4d5d-a7e3-1664ac0af190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:00 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Volume 125860f7-95be-41a0-bc03-19b620360100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-125860f7-95be-41a0-bc03-19b620360100', 'volume_size': 1} Jun 25 18:15:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Acquiring lock "cinder-db9db8cc-6f06-4d77-8095-ce2b280b4f37-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "cinder-db9db8cc-6f06-4d77-8095-ce2b280b4f37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Acquiring lock "cinder-quobyte-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "cinder-quobyte-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Acquiring lock "cinder-quobyte-db9db8cc-6f06-4d77-8095-ce2b280b4f37" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "cinder-quobyte-db9db8cc-6f06-4d77-8095-ce2b280b4f37" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Deleting offline snapshot db9db8cc-6f06-4d77-8095-ce2b280b4f37 of volume a631bb09-2e1a-4b15-9a36-a5d8b7860e5c {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] snapshot_file for this snap is: volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47c02ca-fb5a-4241-b5a7-28efc335ae19]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:01 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-44651829-94d1-4af0-9db4-840b3d6495c8" returned: 0 in 0.901s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] <== create_volume: return (2088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.405s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1086756231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125860f7-95be-41a0-bc03-19b620360100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348d882307d043518a7ad9894278b2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:01Z,use_quota=True,user_id='69183ba8d8764c0eb678f0845311ba50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a33f8c54-d452-49ea-942a-d4f247a086a2),volume_type_id=a33f8c54-d452-49ea-942a-d4f247a086a2)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Creating volume 125860f7-95be-41a0-bc03-19b620360100 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:01 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-125860f7-95be-41a0-bc03-19b620360100 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:01 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 Jun 25 18:15:01 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be2ae42-2e67-48f1-81a1-f297a84cf70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44651829-94d1-4af0-9db4-840b3d6495c8', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7118305f-d522-48ea-ab3b-a3c172305e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:01 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-125860f7-95be-41a0-bc03-19b620360100 1073741824 Jun 25 18:15:01 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:01 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Volume volume-44651829-94d1-4af0-9db4-840b3d6495c8 (44651829-94d1-4af0-9db4-840b3d6495c8): created successfully Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7118305f-d522-48ea-ab3b-a3c172305e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Flow 'volume_create_manager' (64af5c04-d27b-4728-b55b-6a5855417af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:01 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-b1e54d5b-9b36-42ca-a3b4-452f1bf3e722 tempest-VolumesListAdminTestJSON-1038087879 None] Created volume successfully. Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Flow 'volume_create_manager' (44c15298-a31d-48ca-8168-eb305412398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:02 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b16f44-5828-47c0-afbf-1bca3c15c651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37" returned: 0 in 1.148s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b16f44-5828-47c0-afbf-1bca3c15c651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-297950576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7a72e6-cb05-4b7a-bd72-3174c9626459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13af9f0694d49c1aff89140c64ddcc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:02Z,use_quota=True,user_id='0accb1f70cb94265ba6cb0707ccf228a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c05011-711a-4080-ae59-c46090e20fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c05011-711a-4080-ae59-c46090e20fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c95c07-5bf3-4988-8db0-33c7a0d34338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c95c07-5bf3-4988-8db0-33c7a0d34338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7a72e6-cb05-4b7a-bd72-3174c9626459', 'volume_name': 'volume-db7a72e6-cb05-4b7a-bd72-3174c9626459', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c093f4b0-69e0-474d-99eb-5422cb261397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c093f4b0-69e0-474d-99eb-5422cb261397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfca673-13df-48f9-bbec-4dee4ad67e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:02 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Volume db7a72e6-cb05-4b7a-bd72-3174c9626459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7a72e6-cb05-4b7a-bd72-3174c9626459', 'volume_size': 1} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[721155b1-c196-4943-a520-cce45e608a57]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:02 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c Jun 25 18:15:02 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:02 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-125860f7-95be-41a0-bc03-19b620360100 1073741824" returned: 0 in 1.331s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-125860f7-95be-41a0-bc03-19b620360100 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:02 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-125860f7-95be-41a0-bc03-19b620360100 Jun 25 18:15:02 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:03 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c" returned: 0 in 0.887s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:03 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 Jun 25 18:15:03 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:03 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-125860f7-95be-41a0-bc03-19b620360100" returned: 0 in 0.725s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.121s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.972s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-297950576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7a72e6-cb05-4b7a-bd72-3174c9626459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13af9f0694d49c1aff89140c64ddcc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:02Z,use_quota=True,user_id='0accb1f70cb94265ba6cb0707ccf228a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Creating volume db7a72e6-cb05-4b7a-bd72-3174c9626459 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:03 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db7a72e6-cb05-4b7a-bd72-3174c9626459 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb7ebd8-25d3-4d5d-a7e3-1664ac0af190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-125860f7-95be-41a0-bc03-19b620360100', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:03 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db7a72e6-cb05-4b7a-bd72-3174c9626459 1073741824 Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5ae2c1-27cc-4a1a-89b5-bfe50d004f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:03 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:03 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Volume volume-125860f7-95be-41a0-bc03-19b620360100 (125860f7-95be-41a0-bc03-19b620360100): created successfully Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5ae2c1-27cc-4a1a-89b5-bfe50d004f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Flow 'volume_create_manager' (03aef278-70b2-443c-921e-a440a8b4f71d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:03 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-69c71f65-feec-4b94-b537-38475176085c tempest-VolumeTypesAccessTest-509329667 None] Created volume successfully. Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Acquiring lock "cinder-125860f7-95be-41a0-bc03-19b620360100-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Lock "cinder-125860f7-95be-41a0-bc03-19b620360100-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Acquiring lock "cinder-quobyte-125860f7-95be-41a0-bc03-19b620360100" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Lock "cinder-quobyte-125860f7-95be-41a0-bc03-19b620360100" acquired by "delete_volume" :: waited 0.029s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:04 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd601a22-a7f8-4431-951e-43ea23878154]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-125860f7-95be-41a0-bc03-19b620360100 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:04 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-125860f7-95be-41a0-bc03-19b620360100 Jun 25 18:15:04 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:04 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37" returned: 0 in 1.028s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:04 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37 Jun 25 18:15:04 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:04 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db7a72e6-cb05-4b7a-bd72-3174c9626459 1073741824" returned: 0 in 1.242s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db7a72e6-cb05-4b7a-bd72-3174c9626459 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:04 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db7a72e6-cb05-4b7a-bd72-3174c9626459 Jun 25 18:15:04 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:05 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-125860f7-95be-41a0-bc03-19b620360100" returned: 0 in 0.998s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-125860f7-95be-41a0-bc03-19b620360100 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:05 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-125860f7-95be-41a0-bc03-19b620360100 Jun 25 18:15:05 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:05 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c.db9db8cc-6f06-4d77-8095-ce2b280b4f37" returned: 0 in 0.851s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "cinder-quobyte-db9db8cc-6f06-4d77-8095-ce2b280b4f37" released by "_delete_snapshot" :: held 4.101s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "cinder-quobyte-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c" released by "delete_snapshot" :: held 4.136s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Created reservations ['87e75657-baf1-4f0e-9ab5-cc94fc157b7b', 'be88befe-9547-437b-82ba-bb243d5a0bdb', 'ca1ba3a4-d39f-46f7-a7fb-0ab5cef3900e', '6e8f98cf-46fc-499e-9727-4521b97e1605'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:05 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Delete snapshot completed successfully. Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f531711a-5f50-45db-939a-0b5f4b5542cd tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "cinder-db9db8cc-6f06-4d77-8095-ce2b280b4f37-delete_snapshot" released by "delete_snapshot" :: held 4.403s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:05 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db7a72e6-cb05-4b7a-bd72-3174c9626459" returned: 0 in 0.947s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] <== create_volume: return (2249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.253s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfca673-13df-48f9-bbec-4dee4ad67e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7a72e6-cb05-4b7a-bd72-3174c9626459', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c6d229-6a08-4605-b8c1-36668a0a215d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:05 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Volume volume-db7a72e6-cb05-4b7a-bd72-3174c9626459 (db7a72e6-cb05-4b7a-bd72-3174c9626459): created successfully Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c6d229-6a08-4605-b8c1-36668a0a215d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Flow 'volume_create_manager' (44c15298-a31d-48ca-8168-eb305412398b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:05 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7b1e1d1e-d55c-4019-a740-b168c36649cc tempest-VolumesListAdminTestJSON-1038087879 None] Created volume successfully. Jun 25 18:15:05 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-125860f7-95be-41a0-bc03-19b620360100" returned: 0 in 0.904s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Lock "cinder-quobyte-125860f7-95be-41a0-bc03-19b620360100" released by "delete_volume" :: held 1.953s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:06 devstack cinder-volume[93651]: WARNING cinder.quota [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1470136912 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1470136912, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:15:06 devstack cinder-volume[93651]: WARNING cinder.quota [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1470136912 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1470136912, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:15:06 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Created reservations ['c8943470-a106-4013-aba9-4104e13cf2e2', '489574ed-506d-4533-91a9-69d4d148a765', 'bb979302-f741-4236-bff0-b28fdb5c5782', '33b2ca66-b3ad-4263-99bf-3f18665ae335'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:06 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:15:06 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Acquiring lock "cinder-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "cinder-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Acquiring lock "cinder-quobyte-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "cinder-quobyte-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c" acquired by "delete_volume" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:06 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db52605-833a-4d58-b3a3-6cff4db52daa]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:06 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c Jun 25 18:15:06 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:07 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.914s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:07 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Deleted volume successfully. Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d11fd401-dbbc-40c6-912b-84586627ed66 tempest-VolumeTypesAccessTest-509329667 None] Lock "cinder-125860f7-95be-41a0-bc03-19b620360100-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Flow 'volume_create_manager' (0496b4c1-895f-4546-a973-0789d0a6d74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6bd224a-1edb-49d7-9c28-6678f4f8ccfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6bd224a-1edb-49d7-9c28-6678f4f8ccfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e694eaa5-93fd-46d4-b2bb-d2ad304adae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f3b81618274d7da9ca4dd61e5aa179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:07Z,use_quota=True,user_id='7779034eb6bb4b8baf7829b34a312e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c2d796-70e5-4a23-acc8-4cdf94861de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c2d796-70e5-4a23-acc8-4cdf94861de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6a74c1-dd31-4854-aad3-cfbac77ab5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6a74c1-dd31-4854-aad3-cfbac77ab5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e694eaa5-93fd-46d4-b2bb-d2ad304adae5', 'volume_name': 'volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbb1317-d849-4402-ae34-c8b1da11b46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbb1317-d849-4402-ae34-c8b1da11b46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce6cf0e-b5d2-4918-a9b2-6ca6ca2e5903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:07 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Volume e694eaa5-93fd-46d4-b2bb-d2ad304adae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5', 'volume_size': 1} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e694eaa5-93fd-46d4-b2bb-d2ad304adae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f3b81618274d7da9ca4dd61e5aa179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:07Z,use_quota=True,user_id='7779034eb6bb4b8baf7829b34a312e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Creating volume e694eaa5-93fd-46d4-b2bb-d2ad304adae5 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:07 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:07 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5 1073741824 Jun 25 18:15:07 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:07 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c" returned: 0 in 0.929s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:07 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c Jun 25 18:15:07 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:08 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c" returned: 0 in 0.765s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:08 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "cinder-quobyte-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c" released by "delete_volume" :: held 1.781s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:08 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Created reservations ['49092689-d306-48cc-a107-262f7011d92a', '53f2b4f0-3999-499a-beeb-01984914a0cc', '9d9201e0-cddc-4e02-aeb9-d7e331efb079', '953478e8-497e-4672-965d-f7a810947c2a'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:08 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:15:08 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:08 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5 1073741824" returned: 0 in 1.048s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:08 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5 Jun 25 18:15:08 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:09 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.821s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:09 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:09 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Deleted volume successfully. Jun 25 18:15:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-54b44595-15e1-4327-be8e-6320ab2908c9 tempest-SnapshotMetadataTestJSON-1070711520 None] Lock "cinder-a631bb09-2e1a-4b15-9a36-a5d8b7860e5c-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:09 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5" returned: 0 in 1.103s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.210s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce6cf0e-b5d2-4918-a9b2-6ca6ca2e5903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b1511e-438b-4551-8b40-29ddb673d47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:09 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Volume volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5 (e694eaa5-93fd-46d4-b2bb-d2ad304adae5): created successfully Jun 25 18:15:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b1511e-438b-4551-8b40-29ddb673d47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Flow 'volume_create_manager' (0496b4c1-895f-4546-a973-0789d0a6d74c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:09 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-94d6199a-1f44-4505-b67e-cdcb0816d79e tempest-VolumesListAdminTestJSON-736462119 None] Created volume successfully. Jun 25 18:15:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Acquiring lock "cinder-e694eaa5-93fd-46d4-b2bb-d2ad304adae5-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Lock "cinder-e694eaa5-93fd-46d4-b2bb-d2ad304adae5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Acquiring lock "cinder-quobyte-e694eaa5-93fd-46d4-b2bb-d2ad304adae5" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Lock "cinder-quobyte-e694eaa5-93fd-46d4-b2bb-d2ad304adae5" acquired by "delete_volume" :: waited 0.030s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:10 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c96812-7797-4310-aa97-991343550fa4]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "cinder-db7a72e6-cb05-4b7a-bd72-3174c9626459-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "cinder-db7a72e6-cb05-4b7a-bd72-3174c9626459-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "cinder-quobyte-db7a72e6-cb05-4b7a-bd72-3174c9626459" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:11 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5 Jun 25 18:15:11 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "cinder-quobyte-db7a72e6-cb05-4b7a-bd72-3174c9626459" acquired by "delete_volume" :: waited 0.040s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:11 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b371002-5180-4d14-ab27-ad5aba256019]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db7a72e6-cb05-4b7a-bd72-3174c9626459 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:11 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db7a72e6-cb05-4b7a-bd72-3174c9626459 Jun 25 18:15:11 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:12 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db7a72e6-cb05-4b7a-bd72-3174c9626459" returned: 0 in 1.224s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db7a72e6-cb05-4b7a-bd72-3174c9626459 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:12 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5" returned: 0 in 1.558s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:12 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db7a72e6-cb05-4b7a-bd72-3174c9626459 Jun 25 18:15:12 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:12 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5 Jun 25 18:15:12 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:13 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db7a72e6-cb05-4b7a-bd72-3174c9626459" returned: 0 in 1.008s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "cinder-quobyte-db7a72e6-cb05-4b7a-bd72-3174c9626459" released by "delete_volume" :: held 2.321s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Created reservations ['5cebd5f8-58f3-4b17-9261-1e8310698d20', '4d4222ea-f1a3-4808-9b3b-8c08d897d3ef', '656633c4-5b08-40aa-b352-95c69145ed15', '950000e6-5bc4-4f7d-b4fc-09d622a9d58c'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:13 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e694eaa5-93fd-46d4-b2bb-d2ad304adae5" returned: 0 in 1.153s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Lock "cinder-quobyte-e694eaa5-93fd-46d4-b2bb-d2ad304adae5" released by "delete_volume" :: held 2.798s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:13 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:15:13 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Created reservations ['26647d26-4ddd-4e3a-b2ab-ba421b0b6345', 'a7091d38-5e0b-4420-a372-6e04d28234c6', '8c656051-8511-4168-81f9-fc7c9ef00650', 'd9c0d5af-712a-4b60-80ec-0389bf41c6a6'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:14 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:15:14 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Flow 'volume_create_manager' (390332c0-7f65-4585-9d65-f0ab492d08f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a63e6b-552a-4b36-8faf-adba39ad8703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a63e6b-552a-4b36-8faf-adba39ad8703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-456117300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4edbee9-1a2a-4515-8505-732688081540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2170145dbeb748ff819bb99a05b756b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:14Z,use_quota=True,user_id='e8816a3bd17747429c80b332e891a8ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128b2dcf-e5ba-4899-b7de-cc5b847b5f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128b2dcf-e5ba-4899-b7de-cc5b847b5f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f7de22-1e5c-48e7-a6b7-e56fadc0b9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f7de22-1e5c-48e7-a6b7-e56fadc0b9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4edbee9-1a2a-4515-8505-732688081540', 'volume_name': 'volume-e4edbee9-1a2a-4515-8505-732688081540', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1517bdf5-669c-4536-9faa-efd6ae14ea36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1517bdf5-669c-4536-9faa-efd6ae14ea36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee31e15-cb55-407f-aa4a-0b14d2cd6231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:14 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Volume e4edbee9-1a2a-4515-8505-732688081540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4edbee9-1a2a-4515-8505-732688081540', 'volume_size': 1} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-456117300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4edbee9-1a2a-4515-8505-732688081540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2170145dbeb748ff819bb99a05b756b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:14Z,use_quota=True,user_id='e8816a3bd17747429c80b332e891a8ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Creating volume e4edbee9-1a2a-4515-8505-732688081540 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:14 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e4edbee9-1a2a-4515-8505-732688081540 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:14 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e4edbee9-1a2a-4515-8505-732688081540 1073741824 Jun 25 18:15:14 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:14 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.800s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:14 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Deleted volume successfully. Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e3686b4b-a9d7-418f-a219-3bbd9fb326b0 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "cinder-db7a72e6-cb05-4b7a-bd72-3174c9626459-delete_volume" released by "delete_volume" :: held 3.527s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "cinder-44651829-94d1-4af0-9db4-840b3d6495c8-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "cinder-44651829-94d1-4af0-9db4-840b3d6495c8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "cinder-quobyte-44651829-94d1-4af0-9db4-840b3d6495c8" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "cinder-quobyte-44651829-94d1-4af0-9db4-840b3d6495c8" acquired by "delete_volume" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:14 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.896s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:14 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Deleted volume successfully. Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2728bb-2740-47b9-8346-9f6d5ceec772]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-44651829-94d1-4af0-9db4-840b3d6495c8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0357e771-aadd-4b34-98ff-230cb166c886 tempest-VolumesListAdminTestJSON-736462119 None] Lock "cinder-e694eaa5-93fd-46d4-b2bb-d2ad304adae5-delete_volume" released by "delete_volume" :: held 4.122s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:15 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-44651829-94d1-4af0-9db4-840b3d6495c8 Jun 25 18:15:15 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:15 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e4edbee9-1a2a-4515-8505-732688081540 1073741824" returned: 0 in 1.203s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e4edbee9-1a2a-4515-8505-732688081540 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:15 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e4edbee9-1a2a-4515-8505-732688081540 Jun 25 18:15:15 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:15 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-44651829-94d1-4af0-9db4-840b3d6495c8" returned: 0 in 0.899s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-44651829-94d1-4af0-9db4-840b3d6495c8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:15 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-44651829-94d1-4af0-9db4-840b3d6495c8 Jun 25 18:15:15 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:16 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e4edbee9-1a2a-4515-8505-732688081540" returned: 0 in 0.738s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee31e15-cb55-407f-aa4a-0b14d2cd6231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4edbee9-1a2a-4515-8505-732688081540', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab55f043-c218-4dee-8602-900ce02b3226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:16 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Volume volume-e4edbee9-1a2a-4515-8505-732688081540 (e4edbee9-1a2a-4515-8505-732688081540): created successfully Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab55f043-c218-4dee-8602-900ce02b3226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Flow 'volume_create_manager' (390332c0-7f65-4585-9d65-f0ab492d08f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:16 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f3c03f3c-fb51-42a8-b061-cf242e9b7ec1 tempest-VolumesMetadataTest-1164944365 None] Created volume successfully. Jun 25 18:15:16 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-44651829-94d1-4af0-9db4-840b3d6495c8" returned: 0 in 0.728s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "cinder-quobyte-44651829-94d1-4af0-9db4-840b3d6495c8" released by "delete_volume" :: held 1.740s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Created reservations ['36e5e2ae-4c83-4fc7-a5fa-5c4a9a3d6be9', 'b43680fa-af65-456e-8c71-dd6d6feb23cc', '209feea9-a34d-408c-b2c5-61b69cde0877', '1b2a3f9e-d6c3-4bbe-9e4f-56869e9d34dc'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:16 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:15:16 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "cinder-7c161f35-d4a8-46aa-a77f-45c66e343dcf-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "cinder-7c161f35-d4a8-46aa-a77f-45c66e343dcf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "cinder-quobyte-7c161f35-d4a8-46aa-a77f-45c66e343dcf" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "cinder-quobyte-7c161f35-d4a8-46aa-a77f-45c66e343dcf" acquired by "delete_volume" :: waited 0.029s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c551ee67-6f48-47e5-8aab-371a45dd3a96]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Flow 'volume_create_manager' (7e718e45-8d45-4808-bb2d-7fc83107dbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30965287-272f-473a-a743-75b25782658d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:17 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf Jun 25 18:15:17 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30965287-272f-473a-a743-75b25782658d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-986651774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88682b1-d711-43ed-8628-a78aa5d18e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9db38245fb94c0cbf56f8aeaa7ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:17Z,use_quota=True,user_id='0ebd6f2fa5354f4c85fc309bc34104d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221435d0-10c5-48ff-beb7-5ed45c6d5d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221435d0-10c5-48ff-beb7-5ed45c6d5d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a32af45-a410-4316-9de6-7d7d5ba74d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a32af45-a410-4316-9de6-7d7d5ba74d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e88682b1-d711-43ed-8628-a78aa5d18e10', 'volume_name': 'volume-e88682b1-d711-43ed-8628-a78aa5d18e10', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb0b0f0-2239-487e-92a3-7770db608482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb0b0f0-2239-487e-92a3-7770db608482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04018a6-858f-4663-9bd2-98a8a1f3f031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:17 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Volume e88682b1-d711-43ed-8628-a78aa5d18e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e88682b1-d711-43ed-8628-a78aa5d18e10', 'volume_size': 1} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-986651774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88682b1-d711-43ed-8628-a78aa5d18e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9db38245fb94c0cbf56f8aeaa7ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:17Z,use_quota=True,user_id='0ebd6f2fa5354f4c85fc309bc34104d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Creating volume e88682b1-d711-43ed-8628-a78aa5d18e10 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:17 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:15:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:17 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10 1073741824 Jun 25 18:15:17 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:18 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.350s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:18 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:18 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Deleted volume successfully. Jun 25 18:15:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-be002295-6dc8-4f66-8f50-283abd75b2c1 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "cinder-44651829-94d1-4af0-9db4-840b3d6495c8-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Acquiring lock "cinder-e4edbee9-1a2a-4515-8505-732688081540-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Lock "cinder-e4edbee9-1a2a-4515-8505-732688081540-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Acquiring lock "cinder-quobyte-e4edbee9-1a2a-4515-8505-732688081540" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Lock "cinder-quobyte-e4edbee9-1a2a-4515-8505-732688081540" acquired by "delete_volume" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:18 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77b7f41-21cf-4b24-91c4-f8503ada5221]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e4edbee9-1a2a-4515-8505-732688081540 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:18 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e4edbee9-1a2a-4515-8505-732688081540 Jun 25 18:15:18 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:18 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf" returned: 0 in 1.201s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:18 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf Jun 25 18:15:18 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:19 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10 1073741824" returned: 0 in 1.263s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:19 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10 Jun 25 18:15:19 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:19 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e4edbee9-1a2a-4515-8505-732688081540" returned: 0 in 0.967s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e4edbee9-1a2a-4515-8505-732688081540 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:19 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e4edbee9-1a2a-4515-8505-732688081540 Jun 25 18:15:19 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:19 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7c161f35-d4a8-46aa-a77f-45c66e343dcf" returned: 0 in 0.886s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "cinder-quobyte-7c161f35-d4a8-46aa-a77f-45c66e343dcf" released by "delete_volume" :: held 2.181s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Created reservations ['1544abe4-a628-44ef-a075-430624d1cdb1', '87212a94-b786-4fe9-96bb-aa420c94057d', '764f4c4b-e83d-4333-a6ec-2d05dd1786c8', 'a36c0af3-559c-4b5b-9046-d6cd2e978a97'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:19 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:15:19 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:19 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10" returned: 0 in 0.811s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04018a6-858f-4663-9bd2-98a8a1f3f031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e88682b1-d711-43ed-8628-a78aa5d18e10', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1859daff-45e8-4ab8-b540-38603b837e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:19 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Volume volume-e88682b1-d711-43ed-8628-a78aa5d18e10 (e88682b1-d711-43ed-8628-a78aa5d18e10): created successfully Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1859daff-45e8-4ab8-b540-38603b837e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Flow 'volume_create_manager' (7e718e45-8d45-4808-bb2d-7fc83107dbd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:19 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-a4ca2c33-79fe-4369-b3e7-ec986503a6d4 tempest-AttachVolumeTestJSON-1368507731 None] Created volume successfully. Jun 25 18:15:20 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e4edbee9-1a2a-4515-8505-732688081540" returned: 0 in 0.824s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Lock "cinder-quobyte-e4edbee9-1a2a-4515-8505-732688081540" released by "delete_volume" :: held 1.854s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:20 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Created reservations ['b269b4f7-a22d-491a-8a45-8689d87da73a', '80ce123a-2db7-44b3-af6e-077cc3513c63', 'ed688a0a-8fce-4792-a3d0-ff36b065a19f', '1d446977-9203-42b6-a00f-aff540a6f423'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:20 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:15:20 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:20 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.919s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:20 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:20 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Deleted volume successfully. Jun 25 18:15:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c9aeb583-ec20-4206-b508-0809d48fac72 tempest-VolumesListAdminTestJSON-1038087879 None] Lock "cinder-7c161f35-d4a8-46aa-a77f-45c66e343dcf-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:21 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.822s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:21 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:21 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Deleted volume successfully. Jun 25 18:15:21 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-60b8379e-0e3f-4321-ad35-0d6b580d5696 tempest-VolumesMetadataTest-1164944365 None] Lock "cinder-e4edbee9-1a2a-4515-8505-732688081540-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-12bd0bce-ef03-426f-b7be-b62facd6863c req-07ee5812-064f-4f11-aa9a-7e63c607c53d tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-12bd0bce-ef03-426f-b7be-b62facd6863c req-07ee5812-064f-4f11-aa9a-7e63c607c53d tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:25 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c3e924-62b0-4570-bacb-30568551a705]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-12bd0bce-ef03-426f-b7be-b62facd6863c req-07ee5812-064f-4f11-aa9a-7e63c607c53d tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:25 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10 Jun 25 18:15:25 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:26 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-12bd0bce-ef03-426f-b7be-b62facd6863c req-07ee5812-064f-4f11-aa9a-7e63c607c53d tempest-AttachVolumeTestJSON-1368507731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10" returned: 0 in 1.590s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-12bd0bce-ef03-426f-b7be-b62facd6863c req-07ee5812-064f-4f11-aa9a-7e63c607c53d tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.622s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-12bd0bce-ef03-426f-b7be-b62facd6863c req-07ee5812-064f-4f11-aa9a-7e63c607c53d tempest-AttachVolumeTestJSON-1368507731 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-e88682b1-d711-43ed-8628-a78aa5d18e10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64401be3-43d8-45f7-9f26-63485cd4f150', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:15:26 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-12bd0bce-ef03-426f-b7be-b62facd6863c req-07ee5812-064f-4f11-aa9a-7e63c607c53d tempest-AttachVolumeTestJSON-1368507731 None] attachment_update completed successfully. Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Flow 'volume_create_manager' (3e28931e-63e5-480e-b478-8c932fb0bfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6139f8f-e365-42ea-9d80-0dbcb0760bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6139f8f-e365-42ea-9d80-0dbcb0760bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-108540694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6ab4c6-488c-4dd1-a87e-22a4ba07827d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6975d13144cc4d7ab68a14a37b492d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:28Z,use_quota=True,user_id='7f1212bc18f74de7a09d378804637425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984803e0-90b5-49d9-aa0f-7a233e16d2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984803e0-90b5-49d9-aa0f-7a233e16d2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab0781a-9ac1-4831-b71d-72fb04d93ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab0781a-9ac1-4831-b71d-72fb04d93ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea6ab4c6-488c-4dd1-a87e-22a4ba07827d', 'volume_name': 'volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bca0cfc-2324-4e47-82c1-7c27ba45bece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bca0cfc-2324-4e47-82c1-7c27ba45bece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d754fff-9b16-464a-9ce7-007d54241769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:28 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Volume ea6ab4c6-488c-4dd1-a87e-22a4ba07827d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d', 'volume_size': 1} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-108540694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6ab4c6-488c-4dd1-a87e-22a4ba07827d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6975d13144cc4d7ab68a14a37b492d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:28Z,use_quota=True,user_id='7f1212bc18f74de7a09d378804637425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Creating volume ea6ab4c6-488c-4dd1-a87e-22a4ba07827d {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:28 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:15:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:28 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d 1073741824 Jun 25 18:15:28 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:29 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d 1073741824" returned: 0 in 1.253s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:29 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d Jun 25 18:15:29 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Flow 'volume_create_manager' (ecf56eca-89d3-4bf7-aa9a-241a62f7f2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6f4410-ea30-4083-8ddf-b818707bad23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6f4410-ea30-4083-8ddf-b818707bad23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-640433122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c46c95-bf45-4798-8dcc-3aa9d8738d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a0c4a2db4cb41b38b67b0ab3a53f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:30Z,use_quota=True,user_id='c53b58066700400bb03764ad3202ac34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1df0c1-d439-4c0a-a84c-1af13d158956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd1df0c1-d439-4c0a-a84c-1af13d158956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7c6187-270a-473b-bb4f-20506b33991a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7c6187-270a-473b-bb4f-20506b33991a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c46c95-bf45-4798-8dcc-3aa9d8738d8a', 'volume_name': 'volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac486a5-c0a8-431e-a5f6-328d819b018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac486a5-c0a8-431e-a5f6-328d819b018c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a53448-4f6b-4b94-9361-cc82614ab9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:30 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Volume d9c46c95-bf45-4798-8dcc-3aa9d8738d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a', 'volume_size': 1} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:30 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d" returned: 0 in 0.722s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.125s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-640433122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c46c95-bf45-4798-8dcc-3aa9d8738d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a0c4a2db4cb41b38b67b0ab3a53f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:30Z,use_quota=True,user_id='c53b58066700400bb03764ad3202ac34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Creating volume d9c46c95-bf45-4798-8dcc-3aa9d8738d8a {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:30 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d754fff-9b16-464a-9ce7-007d54241769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:30 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a 1073741824 Jun 25 18:15:30 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f19009-0e8d-4382-8d79-2a7cc9030a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:30 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Volume volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d (ea6ab4c6-488c-4dd1-a87e-22a4ba07827d): created successfully Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f19009-0e8d-4382-8d79-2a7cc9030a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Flow 'volume_create_manager' (3e28931e-63e5-480e-b478-8c932fb0bfa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:30 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-25b07979-7d6a-407b-afbe-55599a551d20 tempest-VolumesTransfersV357Test-419015099 None] Created volume successfully. Jun 25 18:15:31 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a 1073741824" returned: 0 in 1.029s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:31 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a Jun 25 18:15:31 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:32 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-5b0d38da-a702-46f0-9b86-40192bf33cbc tempest-VolumesTransfersV357Test-1305019745 None] Transfer volume completed successfully. Jun 25 18:15:32 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a" returned: 0 in 1.028s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Flow 'volume_create_manager' (9c0b8864-9769-4bec-a7bd-c0e091c2b3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6320f019-3159-476d-b10b-062284b4e1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a53448-4f6b-4b94-9361-cc82614ab9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f12f808-ed22-49e5-9971-23b0f90a8af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6320f019-3159-476d-b10b-062284b4e1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-217517612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4c54e4-1024-4438-8be6-3b1c661711ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9db38245fb94c0cbf56f8aeaa7ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:33Z,use_quota=True,user_id='0ebd6f2fa5354f4c85fc309bc34104d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bbbd0b-48be-49bf-9f67-33b322a96b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bbbd0b-48be-49bf-9f67-33b322a96b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1440a9d1-ed2c-4479-b18d-6b51c3f7e017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1440a9d1-ed2c-4479-b18d-6b51c3f7e017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4c54e4-1024-4438-8be6-3b1c661711ea', 'volume_name': 'volume-8f4c54e4-1024-4438-8be6-3b1c661711ea', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb75f18-7487-48b2-aad0-a015682a5f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb75f18-7487-48b2-aad0-a015682a5f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd46876-fec7-4f33-8ca8-0bc40af0f0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:32 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Volume 8f4c54e4-1024-4438-8be6-3b1c661711ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4c54e4-1024-4438-8be6-3b1c661711ea', 'volume_size': 1} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-217517612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4c54e4-1024-4438-8be6-3b1c661711ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9db38245fb94c0cbf56f8aeaa7ad26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:33Z,use_quota=True,user_id='0ebd6f2fa5354f4c85fc309bc34104d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Creating volume 8f4c54e4-1024-4438-8be6-3b1c661711ea {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:32 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:32 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Volume volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a (d9c46c95-bf45-4798-8dcc-3aa9d8738d8a): created successfully Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f12f808-ed22-49e5-9971-23b0f90a8af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:32 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea 1073741824 Jun 25 18:15:32 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Flow 'volume_create_manager' (ecf56eca-89d3-4bf7-aa9a-241a62f7f2ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:32 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-aa51cb22-afea-4897-8884-43b7e73738ff tempest-VolumesDeleteCascade-1346204494 None] Created volume successfully. Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Flow 'volume_create_manager' (79f61feb-da0d-445e-ac9f-d541c0ab58c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2af27b4-2dbc-4069-bc7b-0532e3b96a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2af27b4-2dbc-4069-bc7b-0532e3b96a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-205038529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9785ac4-6586-4d84-bffc-7928149ffbbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715a76f2c35249b8bb3bd4f3a77b4398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:34Z,use_quota=True,user_id='7df164763e254b4e87519897a7dee7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56978a74-355b-4257-99ad-f37bdcffa0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56978a74-355b-4257-99ad-f37bdcffa0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06e2038-bd1e-4837-a2b5-e37ce402513d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06e2038-bd1e-4837-a2b5-e37ce402513d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9785ac4-6586-4d84-bffc-7928149ffbbf', 'volume_name': 'volume-c9785ac4-6586-4d84-bffc-7928149ffbbf', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4b6326-299d-4e9d-99ba-580eb07b4e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4b6326-299d-4e9d-99ba-580eb07b4e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389f69dd-c2e8-4829-951f-a2a1ea58713b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:33 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Volume c9785ac4-6586-4d84-bffc-7928149ffbbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9785ac4-6586-4d84-bffc-7928149ffbbf', 'volume_size': 1} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Acquiring lock "cinder-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Lock "cinder-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Acquiring lock "cinder-quobyte-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Lock "cinder-quobyte-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d" acquired by "delete_volume" :: waited 0.015s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[40213712-0a82-46a0-bf5b-255da345bd11]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:34 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea 1073741824" returned: 0 in 1.173s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:34 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea Jun 25 18:15:34 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:34 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d Jun 25 18:15:34 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:34 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea" returned: 0 in 0.728s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.113s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-205038529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9785ac4-6586-4d84-bffc-7928149ffbbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715a76f2c35249b8bb3bd4f3a77b4398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:34Z,use_quota=True,user_id='7df164763e254b4e87519897a7dee7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Creating volume c9785ac4-6586-4d84-bffc-7928149ffbbf {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:34 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c9785ac4-6586-4d84-bffc-7928149ffbbf 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:34 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c9785ac4-6586-4d84-bffc-7928149ffbbf 1073741824 Jun 25 18:15:34 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd46876-fec7-4f33-8ca8-0bc40af0f0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4c54e4-1024-4438-8be6-3b1c661711ea', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:34 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdeb74b6-79e6-4ad4-b3b3-43c126a65f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d" returned: 0 in 0.882s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:34 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Volume volume-8f4c54e4-1024-4438-8be6-3b1c661711ea (8f4c54e4-1024-4438-8be6-3b1c661711ea): created successfully Jun 25 18:15:34 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d Jun 25 18:15:34 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdeb74b6-79e6-4ad4-b3b3-43c126a65f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Flow 'volume_create_manager' (9c0b8864-9769-4bec-a7bd-c0e091c2b3a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:34 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-410b637c-bba3-4f12-8e99-95d93bd7e77e tempest-AttachVolumeTestJSON-1368507731 None] Created volume successfully. Jun 25 18:15:35 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d" returned: 0 in 0.671s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Lock "cinder-quobyte-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d" released by "delete_volume" :: held 1.603s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:35 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Created reservations ['295dcf56-4c99-4aea-a355-00d99c511ed3', '4b429bd9-c963-429b-96f1-f2f9bd25c085', '1341241b-30fc-4d12-94c8-a6df5c3fb86c', '65f6f403-502c-4712-adf9-e0999bf98030'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:35 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:15:35 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:35 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c9785ac4-6586-4d84-bffc-7928149ffbbf 1073741824" returned: 0 in 1.011s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c9785ac4-6586-4d84-bffc-7928149ffbbf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:35 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c9785ac4-6586-4d84-bffc-7928149ffbbf Jun 25 18:15:35 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:36 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.811s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:36 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Deleted volume successfully. Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0feb9bc5-a383-4d13-94d9-34ce55bf5a9f tempest-VolumesTransfersV357Test-1492450214 None] Lock "cinder-ea6ab4c6-488c-4dd1-a87e-22a4ba07827d-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:36 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c9785ac4-6586-4d84-bffc-7928149ffbbf" returned: 0 in 0.784s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.913s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389f69dd-c2e8-4829-951f-a2a1ea58713b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9785ac4-6586-4d84-bffc-7928149ffbbf', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b08d39-4f37-4c3b-ac33-ba677311315f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] Creating offline snapshot 55c51897-d886-4554-a943-ae09b09221b7 of volume d9c46c95-bf45-4798-8dcc-3aa9d8738d8a {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:15:36 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Volume volume-c9785ac4-6586-4d84-bffc-7928149ffbbf (c9785ac4-6586-4d84-bffc-7928149ffbbf): created successfully Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b08d39-4f37-4c3b-ac33-ba677311315f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Flow 'volume_create_manager' (79f61feb-da0d-445e-ac9f-d541c0ab58c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[2916c760-b80e-4560-a121-24c0bd793838]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:36 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f95c9c64-5088-4dbe-b7d6-0c6ef6fc5be9 tempest-AbsoluteLimitsTests-261795635 None] Created volume successfully. Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Flow 'volume_create_manager' (913504d7-352f-4975-b61e-5ac6ba31994c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2235fc01-1a06-4ae8-b284-451c62830877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2235fc01-1a06-4ae8-b284-451c62830877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-497756613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163afc05-11d7-4434-83a0-dbc0c8cce4e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6975d13144cc4d7ab68a14a37b492d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:37Z,use_quota=True,user_id='7f1212bc18f74de7a09d378804637425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd523a7a-faca-4d4a-9e43-4452ef02818e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:36 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a Jun 25 18:15:36 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd523a7a-faca-4d4a-9e43-4452ef02818e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3173ea0c-85d1-4ff5-9fc1-f40c7d9ff91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3173ea0c-85d1-4ff5-9fc1-f40c7d9ff91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '163afc05-11d7-4434-83a0-dbc0c8cce4e0', 'volume_name': 'volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2addfba6-494c-4da5-9f65-60e3470c548e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2addfba6-494c-4da5-9f65-60e3470c548e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb8e152-a931-4682-88b6-73757cb72157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:36 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Volume 163afc05-11d7-4434-83a0-dbc0c8cce4e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0', 'volume_size': 1} Jun 25 18:15:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:37 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a" returned: 0 in 0.854s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:37 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 1G Jun 25 18:15:37 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Acquiring lock "cinder-c9785ac4-6586-4d84-bffc-7928149ffbbf-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Lock "cinder-c9785ac4-6586-4d84-bffc-7928149ffbbf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Acquiring lock "cinder-quobyte-c9785ac4-6586-4d84-bffc-7928149ffbbf" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Lock "cinder-quobyte-c9785ac4-6586-4d84-bffc-7928149ffbbf" acquired by "delete_volume" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:38 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c739703-79b4-4bcd-b8e1-754e845156a2]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c9785ac4-6586-4d84-bffc-7928149ffbbf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:38 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c9785ac4-6586-4d84-bffc-7928149ffbbf Jun 25 18:15:38 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:38 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 1G" returned: 0 in 0.921s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:38 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 Jun 25 18:15:38 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:39 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c9785ac4-6586-4d84-bffc-7928149ffbbf" returned: 0 in 0.849s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c9785ac4-6586-4d84-bffc-7928149ffbbf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:39 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c9785ac4-6586-4d84-bffc-7928149ffbbf Jun 25 18:15:39 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-8b6af3c9-8ea4-4b20-ae23-6b64a69aeb26 req-ae580a42-5b6c-463e-95a7-e9d5b6b98376 tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:39 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7" returned: 0 in 0.778s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:39 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 is being set with open permissions: ugo+rw Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:39 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:15:39 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:39 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 Jun 25 18:15:39 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:39 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c9785ac4-6586-4d84-bffc-7928149ffbbf" returned: 0 in 0.681s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Lock "cinder-quobyte-c9785ac4-6586-4d84-bffc-7928149ffbbf" released by "delete_volume" :: held 1.589s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Created reservations ['6d8a3cf0-6a28-48ac-8023-658c9bd0b95c', '8143fa68-64ae-433c-8163-987abbf30262', '7bca1dda-a89c-4cea-9eb4-ad841b38e645', '43145044-490c-4e95-aa15-8fa0b400b540'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:39 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:15:39 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:40 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.783s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:40 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7" returned: 0 in 0.761s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:15:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 8 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:15:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:15:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:40 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.info Jun 25 18:15:40 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:40 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.725s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:40 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Deleted volume successfully. Jun 25 18:15:40 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d1647bb4-85e2-4c34-b1c4-ed94ac7b4285 tempest-AbsoluteLimitsTests-261795635 None] Lock "cinder-c9785ac4-6586-4d84-bffc-7928149ffbbf-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:40 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.info" returned: 0 in 0.724s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:40 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.info is being set with open permissions: ugo+rw Jun 25 18:15:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:40 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.info Jun 25 18:15:40 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:41 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.info" returned: 0 in 0.749s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.925s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.681s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-497756613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163afc05-11d7-4434-83a0-dbc0c8cce4e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6975d13144cc4d7ab68a14a37b492d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:37Z,use_quota=True,user_id='7f1212bc18f74de7a09d378804637425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Creating volume 163afc05-11d7-4434-83a0-dbc0c8cce4e0 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:41 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:15:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:41 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0 1073741824 Jun 25 18:15:41 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:41 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-261de700-d888-4885-a6c9-df963d0d5daa tempest-VolumesDeleteCascade-1346204494 None] Create snapshot completed successfully Jun 25 18:15:42 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=86,cinder:UPDATE=116,cinder:INSERT=28,cinder:DELETE=15 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:15:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:42 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0 1073741824" returned: 0 in 1.072s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:42 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0 Jun 25 18:15:42 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:43 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0" returned: 0 in 0.718s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-8b6af3c9-8ea4-4b20-ae23-6b64a69aeb26 req-ae580a42-5b6c-463e-95a7-e9d5b6b98376 tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.417s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb8e152-a931-4682-88b6-73757cb72157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68fd0a3f-5c4a-4f0b-b375-1d8413d35e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:43 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[052aaca6-f21e-4bf3-8e76-949c71347eae]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-8b6af3c9-8ea4-4b20-ae23-6b64a69aeb26 req-ae580a42-5b6c-463e-95a7-e9d5b6b98376 tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:43 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Volume volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0 (163afc05-11d7-4434-83a0-dbc0c8cce4e0): created successfully Jun 25 18:15:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68fd0a3f-5c4a-4f0b-b375-1d8413d35e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Flow 'volume_create_manager' (913504d7-352f-4975-b61e-5ac6ba31994c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:43 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-cc089126-61e1-4f75-b6eb-33e3ee747d68 tempest-VolumesTransfersV357Test-419015099 None] Created volume successfully. Jun 25 18:15:43 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=96,cinder:UPDATE=124,cinder:DELETE=9,cinder:INSERT=26 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:15:43 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea Jun 25 18:15:43 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:44 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-8b6af3c9-8ea4-4b20-ae23-6b64a69aeb26 req-ae580a42-5b6c-463e-95a7-e9d5b6b98376 tempest-AttachVolumeTestJSON-1368507731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea" returned: 0 in 0.866s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-8b6af3c9-8ea4-4b20-ae23-6b64a69aeb26 req-ae580a42-5b6c-463e-95a7-e9d5b6b98376 tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.891s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.830s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] Creating offline snapshot 4f98666e-09cd-47e6-b8c3-74b973ebf7a8 of volume d9c46c95-bf45-4798-8dcc-3aa9d8738d8a {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[3306cdb5-f4aa-445b-9e43-4909eb20527b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-8b6af3c9-8ea4-4b20-ae23-6b64a69aeb26 req-ae580a42-5b6c-463e-95a7-e9d5b6b98376 tempest-AttachVolumeTestJSON-1368507731 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-8f4c54e4-1024-4438-8be6-3b1c661711ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '754b9b31-5e7b-4ffc-8b98-eb696505714e', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:15:44 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-8b6af3c9-8ea4-4b20-ae23-6b64a69aeb26 req-ae580a42-5b6c-463e-95a7-e9d5b6b98376 tempest-AttachVolumeTestJSON-1368507731 None] attachment_update completed successfully. Jun 25 18:15:44 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 Jun 25 18:15:44 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Flow 'volume_create_manager' (07404962-1b85-44e9-800f-5b5544d68937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5a22bc-bc1e-4819-a08b-bda957195d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5a22bc-bc1e-4819-a08b-bda957195d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1172034564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba90ad0c-b6df-4435-a099-6cd1ad50ce0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438cdba8443948fe8ad96f617de0f69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:45Z,use_quota=True,user_id='2a2feae464724925bfb8d817c228e3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb7d7bb-8743-4271-8d81-1b2b63cb0691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb7d7bb-8743-4271-8d81-1b2b63cb0691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d58a41-9bf8-4a27-b86e-e1d2deccf212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d58a41-9bf8-4a27-b86e-e1d2deccf212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba90ad0c-b6df-4435-a099-6cd1ad50ce0f', 'volume_name': 'volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f', 'volume_size': 2}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcefe7bd-8f93-4e9d-8c4f-1150a3325664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcefe7bd-8f93-4e9d-8c4f-1150a3325664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c27005f-7bd0-4de5-9f59-e686c7feedad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:44 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Volume ba90ad0c-b6df-4435-a099-6cd1ad50ce0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f', 'volume_size': 2} Jun 25 18:15:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:45 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Acquiring lock "cinder-163afc05-11d7-4434-83a0-dbc0c8cce4e0-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:45 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Lock "cinder-163afc05-11d7-4434-83a0-dbc0c8cce4e0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:45 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Acquiring lock "cinder-quobyte-163afc05-11d7-4434-83a0-dbc0c8cce4e0" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:45 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Lock "cinder-quobyte-163afc05-11d7-4434-83a0-dbc0c8cce4e0" acquired by "delete_volume" :: waited 0.028s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:45 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35baf6c-b9bd-4c34-958d-4db1d67656de]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:45 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0 Jun 25 18:15:45 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:45 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7" returned: 0 in 0.943s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:15:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:45 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 1G Jun 25 18:15:45 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:46 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0" returned: 0 in 0.845s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:46 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0 Jun 25 18:15:46 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:46 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 1G" returned: 0 in 1.030s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:46 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 Jun 25 18:15:46 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:46 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-163afc05-11d7-4434-83a0-dbc0c8cce4e0" returned: 0 in 0.813s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:46 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Lock "cinder-quobyte-163afc05-11d7-4434-83a0-dbc0c8cce4e0" released by "delete_volume" :: held 1.707s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:46 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Created reservations ['05264911-331a-4c1a-b9c6-b1165df689d1', '0b8d200f-fce2-4d76-8a63-04bbb9ed06ff', 'ce1f07b8-f877-4163-bcc1-7d0574ec9614', '0ab4ce2a-4dce-47d3-988c-4d20cda49ba9'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:47 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:15:47 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:47 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8" returned: 0 in 0.803s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:47 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 is being set with open permissions: ugo+rw Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:47 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 Jun 25 18:15:47 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:47 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.722s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:47 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Deleted volume successfully. Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-58b26f11-fe01-4420-87c9-02f9e2374b0b tempest-VolumesTransfersV357Test-1492450214 None] Lock "cinder-163afc05-11d7-4434-83a0-dbc0c8cce4e0-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:47 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8" returned: 0 in 0.711s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.616s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.015s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1172034564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba90ad0c-b6df-4435-a099-6cd1ad50ce0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438cdba8443948fe8ad96f617de0f69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:45Z,use_quota=True,user_id='2a2feae464724925bfb8d817c228e3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Creating volume ba90ad0c-b6df-4435-a099-6cd1ad50ce0f {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:48 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:15:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f 2147483648 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:48 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f 2147483648 Jun 25 18:15:48 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:48 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-910b9a1b-0f3d-4e65-a12c-3097983d0338 tempest-VolumesDeleteCascade-1346204494 None] Create snapshot completed successfully Jun 25 18:15:48 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Performing cascade delete. {{(pid=93651) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1025}} Jun 25 18:15:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-4f98666e-09cd-47e6-b8c3-74b973ebf7a8-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-4f98666e-09cd-47e6-b8c3-74b973ebf7a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-quobyte-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-quobyte-4f98666e-09cd-47e6-b8c3-74b973ebf7a8" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-4f98666e-09cd-47e6-b8c3-74b973ebf7a8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Deleting offline snapshot 4f98666e-09cd-47e6-b8c3-74b973ebf7a8 of volume d9c46c95-bf45-4798-8dcc-3aa9d8738d8a {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:15:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] snapshot_file for this snap is: volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:15:49 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f 2147483648" returned: 0 in 1.296s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:49 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[08abded7-a75e-4da1-8e76-625d9e67ce38]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:49 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f Jun 25 18:15:49 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:49 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 Jun 25 18:15:49 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:50 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f" returned: 0 in 0.811s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c27005f-7bd0-4de5-9f59-e686c7feedad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f', 'volume_size': 2}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4844bf32-9a13-4e97-8b7e-326fc191c62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:50 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Volume volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f (ba90ad0c-b6df-4435-a099-6cd1ad50ce0f): created successfully Jun 25 18:15:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4844bf32-9a13-4e97-8b7e-326fc191c62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Flow 'volume_create_manager' (07404962-1b85-44e9-800f-5b5544d68937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:50 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-0a8d2d71-7695-470d-b392-bc290026f6c1 tempest-VolumesCloneNegativeTest-1148640753 None] Created volume successfully. Jun 25 18:15:50 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8" returned: 0 in 1.059s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:15:50 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d552fd-1a17-449b-a5c7-8ed6a09de2df]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:50 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 Jun 25 18:15:50 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:50 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-5132b502-04b6-4cb9-881d-d2adb76ac65d req-b9cc4381-0efe-4590-b8df-b9ceb1f20ce6 tempest-AttachVolumeTestJSON-1368507731 None] Terminate volume connection completed successfully. Jun 25 18:15:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-5132b502-04b6-4cb9-881d-d2adb76ac65d req-b9cc4381-0efe-4590-b8df-b9ceb1f20ce6 tempest-AttachVolumeTestJSON-1368507731 None] Deleting attachment 64401be3-43d8-45f7-9f26-63485cd4f150. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:15:51 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7" returned: 0 in 0.855s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:51 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:15:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:51 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 Jun 25 18:15:51 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Acquiring lock "cinder-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Lock "cinder-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Acquiring lock "cinder-quobyte-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Lock "cinder-quobyte-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f" acquired by "delete_volume" :: waited 0.027s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:51 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[150fbe78-7d23-46a8-a240-21455589b990]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:52 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f Jun 25 18:15:52 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:52 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8" returned: 0 in 1.142s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:52 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8 Jun 25 18:15:52 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:52 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f" returned: 0 in 0.933s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:52 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f Jun 25 18:15:52 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:53 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.4f98666e-09cd-47e6-b8c3-74b973ebf7a8" returned: 0 in 0.835s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-4f98666e-09cd-47e6-b8c3-74b973ebf7a8" released by "_delete_snapshot" :: held 4.042s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a" released by "delete_snapshot" :: held 4.071s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Created reservations ['ba938be6-d139-4b3d-bf19-11102f24988c', 'ece91f2a-d954-4871-bdd0-ea8cb72e7a8a', '9402943e-29a5-4a69-98dd-d52c754c4627', 'd709d57f-ada5-4f86-b831-6138cc196aad'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:53 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Delete snapshot completed successfully. Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-4f98666e-09cd-47e6-b8c3-74b973ebf7a8-delete_snapshot" released by "delete_snapshot" :: held 4.336s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-55c51897-d886-4554-a943-ae09b09221b7-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-55c51897-d886-4554-a943-ae09b09221b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-quobyte-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:53 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-2e4d959c-b8d2-4f00-94cc-60930a963a71 req-24e18e7e-5c06-4f86-9538-fc23f35b52b0 tempest-AttachVolumeTestJSON-1368507731 None] Terminate volume connection completed successfully. Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-2e4d959c-b8d2-4f00-94cc-60930a963a71 req-24e18e7e-5c06-4f86-9538-fc23f35b52b0 tempest-AttachVolumeTestJSON-1368507731 None] Deleting attachment 754b9b31-5e7b-4ffc-8b98-eb696505714e. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-quobyte-55c51897-d886-4554-a943-ae09b09221b7" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-55c51897-d886-4554-a943-ae09b09221b7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Deleting offline snapshot 55c51897-d886-4554-a943-ae09b09221b7 of volume d9c46c95-bf45-4798-8dcc-3aa9d8738d8a {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] snapshot_file for this snap is: volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c37f79b-378d-4908-aecf-ed40cd489de7]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:53 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f" returned: 0 in 0.901s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Lock "cinder-quobyte-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f" released by "delete_volume" :: held 1.924s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:53 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 Jun 25 18:15:53 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Created reservations ['d3b46fee-f8c0-4283-86e6-dcdbdfb19306', '04bc48d7-3dfd-4748-815b-b5dd746dc952', '1d953650-35ba-43d8-870f-b7db780fcbe0', '1057a15b-7690-4953-aaae-de7aa6ee07df'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:53 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:15:53 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Flow 'volume_create_manager' (c982b7dc-2891-4995-9ebc-7a5baf7abdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89213a0c-288f-433d-b1cb-b53e2749b6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89213a0c-288f-433d-b1cb-b53e2749b6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-119856417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ac0c87-843a-4adb-b0dd-c3358ab2465b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a7d5e9364e4455c95695db88e2f1c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:55Z,use_quota=True,user_id='5eb42da769b8496a940363db729a1f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797e5c7b-9e2e-4f88-8ef9-193fc0a6588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797e5c7b-9e2e-4f88-8ef9-193fc0a6588c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e807b240-1cc2-45fa-a995-b06517dad097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e807b240-1cc2-45fa-a995-b06517dad097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ac0c87-843a-4adb-b0dd-c3358ab2465b', 'volume_name': 'volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abc1433-555b-4aef-8dcb-3a12a524788c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abc1433-555b-4aef-8dcb-3a12a524788c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a8fb37-9042-4e23-a18c-805916ebee8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:54 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Volume 54ac0c87-843a-4adb-b0dd-c3358ab2465b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b', 'volume_size': 1} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-119856417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ac0c87-843a-4adb-b0dd-c3358ab2465b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a7d5e9364e4455c95695db88e2f1c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:55Z,use_quota=True,user_id='5eb42da769b8496a940363db729a1f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Creating volume 54ac0c87-843a-4adb-b0dd-c3358ab2465b {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:54 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:54 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7" returned: 0 in 1.163s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:15:54 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:54 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b 1073741824 Jun 25 18:15:54 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.968s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:15:54 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Deleted volume successfully. Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[734f208b-d764-44f8-a1d7-cdef4469af22]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:54 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f0e59f1-7d34-40f4-a051-ca4318488990 tempest-VolumesCloneNegativeTest-1148640753 None] Lock "cinder-ba90ad0c-b6df-4435-a099-6cd1ad50ce0f-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:55 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a Jun 25 18:15:55 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:55 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a" returned: 0 in 0.999s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:55 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 Jun 25 18:15:55 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:56 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b 1073741824" returned: 0 in 1.232s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:56 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b Jun 25 18:15:56 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:56 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7" returned: 0 in 0.943s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:56 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7 Jun 25 18:15:56 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:56 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b" returned: 0 in 0.905s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] <== create_volume: return (2200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:15:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.205s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a8fb37-9042-4e23-a18c-805916ebee8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f444f317-f900-4a09-9418-68e94bc78073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:57 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Volume volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b (54ac0c87-843a-4adb-b0dd-c3358ab2465b): created successfully Jun 25 18:15:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f444f317-f900-4a09-9418-68e94bc78073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Flow 'volume_create_manager' (c982b7dc-2891-4995-9ebc-7a5baf7abdb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:57 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-05de6c3a-61f9-463f-9b4d-413a8c8eff3c tempest-VolumesListTestJSON-1326046809 None] Created volume successfully. Jun 25 18:15:57 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a.55c51897-d886-4554-a943-ae09b09221b7" returned: 0 in 0.881s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-55c51897-d886-4554-a943-ae09b09221b7" released by "_delete_snapshot" :: held 4.168s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a" released by "delete_snapshot" :: held 4.199s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:57 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Created reservations ['0d438672-6232-4aa7-ba32-5e13007d71d1', '55e1e16c-9893-4a28-9fe2-bdb186d6cc54', '6eee8f0c-d86f-4bc1-ade4-02cf989f3406', '6a0c8c3f-6f91-480a-9ae2-0457459d6edb'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:15:58 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Delete snapshot completed successfully. Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-55c51897-d886-4554-a943-ae09b09221b7-delete_snapshot" released by "delete_snapshot" :: held 4.545s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Snapshots deleted, issuing volume delete {{(pid=93651) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1040}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-quobyte-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a" acquired by "delete_volume" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28c949b-0ecc-4c96-acf9-6964433d0473]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:58 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a Jun 25 18:15:58 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Flow 'volume_create_manager' (c4d28564-7211-4fe0-804e-9c9a68625c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592bf523-146a-47ac-9afd-b532a34c0354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592bf523-146a-47ac-9afd-b532a34c0354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1924029001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d038350-d54f-4e56-88fc-c843bd521b57,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a7d5e9364e4455c95695db88e2f1c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:59Z,use_quota=True,user_id='5eb42da769b8496a940363db729a1f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4b83ba-6f61-4984-9bf7-a2f1f2658481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4b83ba-6f61-4984-9bf7-a2f1f2658481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d65dcd9-fa0e-4f64-bc4f-2b5807b80f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d65dcd9-fa0e-4f64-bc4f-2b5807b80f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d038350-d54f-4e56-88fc-c843bd521b57', 'volume_name': 'volume-4d038350-d54f-4e56-88fc-c843bd521b57', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45964fda-10f6-4d33-8876-e116bd148a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45964fda-10f6-4d33-8876-e116bd148a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f538c60e-6762-4f0f-afc3-bda1ad424db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:58 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Volume 4d038350-d54f-4e56-88fc-c843bd521b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d038350-d54f-4e56-88fc-c843bd521b57', 'volume_size': 1} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1924029001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d038350-d54f-4e56-88fc-c843bd521b57,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a7d5e9364e4455c95695db88e2f1c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:15:59Z,use_quota=True,user_id='5eb42da769b8496a940363db729a1f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Creating volume 4d038350-d54f-4e56-88fc-c843bd521b57 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:15:58 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:15:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d038350-d54f-4e56-88fc-c843bd521b57 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:58 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d038350-d54f-4e56-88fc-c843bd521b57 1073741824 Jun 25 18:15:58 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:59 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jun 25 18:15:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a" returned: 0 in 1.147s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:15:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:15:59 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a Jun 25 18:15:59 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:15:59 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:15:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Flow 'volume_create_manager' (d20d0cba-c562-46bf-8ffe-b709f3cc258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:15:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ec308f-b51c-499b-b095-56343d23a9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ec308f-b51c-499b-b095-56343d23a9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1802266162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24bbb7b1-ce69-4140-993b-44445a0e12f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c999483494147818e4ced9bb1d51cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:00Z,use_quota=True,user_id='77ae8efe0b9d4a08b8938d5e3edeb348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0add17b3-b889-4928-8169-2620f3ed907d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0add17b3-b889-4928-8169-2620f3ed907d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:15:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d19623e-2506-46f9-b255-d277e4d38f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:15:59 devstack cinder-volume[93651]: DEBUG cinder.image.glance [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Creating Keystone auth plugin from conf {{(pid=93651) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:16:00 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d038350-d54f-4e56-88fc-c843bd521b57 1073741824" returned: 0 in 1.346s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d038350-d54f-4e56-88fc-c843bd521b57 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:00 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d038350-d54f-4e56-88fc-c843bd521b57 Jun 25 18:16:00 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d19623e-2506-46f9-b255-d277e4d38f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '24bbb7b1-ce69-4140-993b-44445a0e12f8', 'volume_name': 'volume-24bbb7b1-ce69-4140-993b-44445a0e12f8', 'volume_size': 1, 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab240da4b4934e58a24c7f836ed62427', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'created_at': datetime.datetime(2026, 6, 25, 15, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 58, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f387e2-c860-475c-ac99-cdd41f08284b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f387e2-c860-475c-ac99-cdd41f08284b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7482852-5267-48fa-97d0-48ceaaa92255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:00 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Volume 24bbb7b1-ce69-4140-993b-44445a0e12f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-24bbb7b1-ce69-4140-993b-44445a0e12f8', 'volume_size': 1, 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab240da4b4934e58a24c7f836ed62427', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'created_at': datetime.datetime(2026, 6, 25, 15, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 58, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Trying to clone 24bbb7b1-ce69-4140-993b-44445a0e12f8 from image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c at location (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]). {{(pid=93651) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:16:00 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a" returned: 0 in 1.103s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a" released by "delete_volume" :: held 2.365s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Created reservations ['cde53c8a-1d73-4a82-ab78-e071f71950e8', '818941c3-09b0-454f-973d-aef8939c437b', '885bed6a-41df-4170-9d55-422d0e4ce5dd', 'c36ef749-a92d-4166-8066-eacd4bf86746'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:00 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:16:00 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:00 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_gzxv9xf9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:16:00 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Image download 20.69 MB at 20.69 MB/s Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eefa30-0918-412b-b8fa-d97ed6033834]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_gzxv9xf9devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:01 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_gzxv9xf9devstack@QuobyteHD Jun 25 18:16:01 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:01 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d038350-d54f-4e56-88fc-c843bd521b57" returned: 0 in 0.944s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] <== create_volume: return (2382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.388s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f538c60e-6762-4f0f-afc3-bda1ad424db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d038350-d54f-4e56-88fc-c843bd521b57', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379d4d46-af81-4059-86f2-668cb09c66a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:01 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Volume volume-4d038350-d54f-4e56-88fc-c843bd521b57 (4d038350-d54f-4e56-88fc-c843bd521b57): created successfully Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379d4d46-af81-4059-86f2-668cb09c66a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Flow 'volume_create_manager' (c4d28564-7211-4fe0-804e-9c9a68625c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:01 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-3deb29f4-dde3-4d58-bc49-d25f8f09018f tempest-VolumesListTestJSON-1326046809 None] Created volume successfully. Jun 25 18:16:01 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.901s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:01 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Deleted volume successfully. Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4cda2c1-87fa-4ac1-a463-81cf59b11ace tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-d9c46c95-bf45-4798-8dcc-3aa9d8738d8a-delete_volume" released by "delete_volume" :: held 12.746s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:01 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_gzxv9xf9devstack@QuobyteHD" returned: 0 in 0.875s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Temporary image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c is fetched for user 77ae8efe0b9d4a08b8938d5e3edeb348. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:16:01 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[d277ca4a-214d-404b-b1be-f5a6972bab4b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_gzxv9xf9devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:02 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_gzxv9xf9devstack@QuobyteHD Jun 25 18:16:02 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Flow 'volume_create_manager' (d731019c-c941-43ee-a171-f87e3ed90789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b18a5f-0fa6-46fb-a63f-78eab3c0c8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b18a5f-0fa6-46fb-a63f-78eab3c0c8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1781418754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49df9f69-102f-4e36-8690-d7dc916d178e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a0c4a2db4cb41b38b67b0ab3a53f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:02Z,use_quota=True,user_id='c53b58066700400bb03764ad3202ac34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636cc1cc-9a30-4a80-b84f-dfdff6a13c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636cc1cc-9a30-4a80-b84f-dfdff6a13c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c61521-5d47-4b1a-80aa-fe0c0dcda69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c61521-5d47-4b1a-80aa-fe0c0dcda69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49df9f69-102f-4e36-8690-d7dc916d178e', 'volume_name': 'volume-49df9f69-102f-4e36-8690-d7dc916d178e', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a10c99-a0fe-4502-a789-f0a96da34940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a10c99-a0fe-4502-a789-f0a96da34940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea02679-428b-43a0-b13e-d973ffb795ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:02 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Volume 49df9f69-102f-4e36-8690-d7dc916d178e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49df9f69-102f-4e36-8690-d7dc916d178e', 'volume_size': 1} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1781418754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49df9f69-102f-4e36-8690-d7dc916d178e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a0c4a2db4cb41b38b67b0ab3a53f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:02Z,use_quota=True,user_id='c53b58066700400bb03764ad3202ac34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Creating volume 49df9f69-102f-4e36-8690-d7dc916d178e {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:02 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:02 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e 1073741824 Jun 25 18:16:02 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Flow 'volume_create_manager' (5df42b48-bb24-4d7e-99ab-ebf241782025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f5acd4-c85a-4e01-8b16-95b7bb216a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f5acd4-c85a-4e01-8b16-95b7bb216a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1521238229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2880e767-ca15-49d3-b64c-f16303b9a2a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a7d5e9364e4455c95695db88e2f1c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:03Z,use_quota=True,user_id='5eb42da769b8496a940363db729a1f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c876fe2-f176-42c5-ae31-1ef7bf7fd537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c876fe2-f176-42c5-ae31-1ef7bf7fd537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844285a0-3df2-40fc-8ac1-8479533ea039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844285a0-3df2-40fc-8ac1-8479533ea039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2880e767-ca15-49d3-b64c-f16303b9a2a4', 'volume_name': 'volume-2880e767-ca15-49d3-b64c-f16303b9a2a4', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fec34e-13b0-47ee-af28-959ddbe0415b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fec34e-13b0-47ee-af28-959ddbe0415b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ccc460-ae1f-4e31-b7ab-f1186773c924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:03 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Volume 2880e767-ca15-49d3-b64c-f16303b9a2a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2880e767-ca15-49d3-b64c-f16303b9a2a4', 'volume_size': 1} Jun 25 18:16:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:03 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_gzxv9xf9devstack@QuobyteHD" returned: 0 in 1.020s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:03 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e 1073741824" returned: 0 in 1.071s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:03 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e Jun 25 18:16:03 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:04 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e" returned: 0 in 0.666s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.245s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1521238229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2880e767-ca15-49d3-b64c-f16303b9a2a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a7d5e9364e4455c95695db88e2f1c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:03Z,use_quota=True,user_id='5eb42da769b8496a940363db729a1f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Creating volume 2880e767-ca15-49d3-b64c-f16303b9a2a4 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:04 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2880e767-ca15-49d3-b64c-f16303b9a2a4 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea02679-428b-43a0-b13e-d973ffb795ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49df9f69-102f-4e36-8690-d7dc916d178e', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac453f9-af5b-4c8d-9e8e-db04f180bc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:04 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2880e767-ca15-49d3-b64c-f16303b9a2a4 1073741824 Jun 25 18:16:04 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:04 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Volume volume-49df9f69-102f-4e36-8690-d7dc916d178e (49df9f69-102f-4e36-8690-d7dc916d178e): created successfully Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac453f9-af5b-4c8d-9e8e-db04f180bc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Flow 'volume_create_manager' (d731019c-c941-43ee-a171-f87e3ed90789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e20efe6f-486e-46aa-af15-2d213129bc27 tempest-VolumesDeleteCascade-1346204494 None] Created volume successfully. Jun 25 18:16:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:05 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2880e767-ca15-49d3-b64c-f16303b9a2a4 1073741824" returned: 0 in 1.010s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2880e767-ca15-49d3-b64c-f16303b9a2a4 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:05 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2880e767-ca15-49d3-b64c-f16303b9a2a4 Jun 25 18:16:05 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "cinder-8f4c54e4-1024-4438-8be6-3b1c661711ea-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Lock "cinder-8f4c54e4-1024-4438-8be6-3b1c661711ea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "cinder-quobyte-8f4c54e4-1024-4438-8be6-3b1c661711ea" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Lock "cinder-quobyte-8f4c54e4-1024-4438-8be6-3b1c661711ea" acquired by "delete_volume" :: waited 0.018s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:05 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa847fd9-1a4d-489e-9d69-0018ddde90ef]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:05 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea Jun 25 18:16:05 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:06 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2880e767-ca15-49d3-b64c-f16303b9a2a4" returned: 0 in 0.798s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.091s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1802266162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24bbb7b1-ce69-4140-993b-44445a0e12f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c999483494147818e4ced9bb1d51cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:00Z,use_quota=True,user_id='77ae8efe0b9d4a08b8938d5e3edeb348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Creating volume 24bbb7b1-ce69-4140-993b-44445a0e12f8 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:06 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:06 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 1073741824 Jun 25 18:16:06 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ccc460-ae1f-4e31-b7ab-f1186773c924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2880e767-ca15-49d3-b64c-f16303b9a2a4', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284ea883-a5da-44e6-9ee9-97ad2d3ef532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:06 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Volume volume-2880e767-ca15-49d3-b64c-f16303b9a2a4 (2880e767-ca15-49d3-b64c-f16303b9a2a4): created successfully Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284ea883-a5da-44e6-9ee9-97ad2d3ef532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Flow 'volume_create_manager' (5df42b48-bb24-4d7e-99ab-ebf241782025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:06 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-1c838053-9fdd-49e9-a3c3-d9dd71c0143f tempest-VolumesListTestJSON-1326046809 None] Created volume successfully. Jun 25 18:16:06 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea" returned: 0 in 0.907s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:06 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea Jun 25 18:16:06 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:07 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 1073741824" returned: 0 in 0.929s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:07 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 Jun 25 18:16:07 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:07 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8f4c54e4-1024-4438-8be6-3b1c661711ea" returned: 0 in 0.744s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Lock "cinder-quobyte-8f4c54e4-1024-4438-8be6-3b1c661711ea" released by "delete_volume" :: held 1.702s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Created reservations ['0fde8bcc-16c4-4d17-ade0-8474809d9b4a', '2fb116f0-1f42-46b2-8e24-aa756b5010e4', 'b5976477-aabf-4f30-bad7-be14d4b9ddd8', 'aa32eda8-ddd5-4a85-a158-1b60871cc091'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:07 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:16:07 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:07 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8" returned: 0 in 0.854s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.288s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "cinder-e88682b1-d711-43ed-8628-a78aa5d18e10-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] Creating offline snapshot d80e8584-b21f-44e7-a47d-6ca68dcf79e6 of volume 49df9f69-102f-4e36-8690-d7dc916d178e {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:16:08 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Attempting download of 2834cfdd-f1d3-4acf-a5ec-74a95c79167c ((None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}])) to volume 24bbb7b1-ce69-4140-993b-44445a0e12f8. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:16:08 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Lock "cinder-e88682b1-d711-43ed-8628-a78aa5d18e10-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:08 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[25af9370-6dd0-4a17-93e3-c96c9dac4439]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:08 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "cinder-quobyte-e88682b1-d711-43ed-8628-a78aa5d18e10" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:08 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[279b0313-9977-4730-a1b7-c479e4fd171f]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_hbp893ij {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:08 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Lock "cinder-quobyte-e88682b1-d711-43ed-8628-a78aa5d18e10" acquired by "delete_volume" :: waited 0.048s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:08 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[616e59c7-dd09-487c-8403-d61af74c572f]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:08 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e Jun 25 18:16:08 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:08 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10 Jun 25 18:16:08 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:08 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_hbp893ij Jun 25 18:16:08 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:08 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.045s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:08 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:08 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Deleted volume successfully. Jun 25 18:16:08 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f78a9951-e17e-4530-b6f0-1edd7732aa37 tempest-AttachVolumeTestJSON-1368507731 None] Lock "cinder-8f4c54e4-1024-4438-8be6-3b1c661711ea-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:09 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_hbp893ij" returned: 0 in 0.976s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_hbp893ij {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:09 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e" returned: 0 in 1.168s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:09 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 1G Jun 25 18:16:09 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:09 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_hbp893ij Jun 25 18:16:09 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:09 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10" returned: 0 in 1.138s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:09 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10 Jun 25 18:16:09 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:10 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_hbp893ij" returned: 1 in 1.015s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_hbp893ij' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ed8642-d86e-4a93-840c-9524f5a5c33e]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_gzxv9xf9devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:10 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e88682b1-d711-43ed-8628-a78aa5d18e10" returned: 0 in 0.869s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Lock "cinder-quobyte-e88682b1-d711-43ed-8628-a78aa5d18e10" released by "delete_volume" :: held 2.073s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:10 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:10 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_gzxv9xf9devstack@QuobyteHD Jun 25 18:16:10 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 1G" returned: 0 in 1.080s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49df9f69-102f-4e36-8690-d7dc916d178e -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Created reservations ['795de3d6-f598-4838-9047-b9399f5f95f6', 'cc85eb30-23c3-4bc0-a6c1-d318cafc8940', '72076af9-7e54-4c4c-95d5-f59deb0838e6', '6582f99f-3157-4ca1-9a3c-86bf8be1a111'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:10 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49df9f69-102f-4e36-8690-d7dc916d178e -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 Jun 25 18:16:10 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:10 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:16:10 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "cinder-2880e767-ca15-49d3-b64c-f16303b9a2a4-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Lock "cinder-2880e767-ca15-49d3-b64c-f16303b9a2a4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "cinder-quobyte-2880e767-ca15-49d3-b64c-f16303b9a2a4" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Lock "cinder-quobyte-2880e767-ca15-49d3-b64c-f16303b9a2a4" acquired by "delete_volume" :: waited 0.025s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3d6ba9-7429-48eb-b426-0200b366ea64]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2880e767-ca15-49d3-b64c-f16303b9a2a4 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:10 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2880e767-ca15-49d3-b64c-f16303b9a2a4 Jun 25 18:16:10 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:11 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_gzxv9xf9devstack@QuobyteHD" returned: 0 in 0.890s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] 2834cfdd-f1d3-4acf-a5ec-74a95c79167c was qcow2, converting to raw {{(pid=93651) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_gzxv9xf9devstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:11 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_gzxv9xf9devstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 Jun 25 18:16:11 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:11 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49df9f69-102f-4e36-8690-d7dc916d178e -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6" returned: 0 in 0.933s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:11 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 is being set with open permissions: ugo+rw Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:11 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 Jun 25 18:16:11 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:11 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.822s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:11 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Deleted volume successfully. Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-42e4a2f7-49da-4d22-a89f-ae8c48bf15c3 tempest-AttachVolumeTestJSON-1368507731 None] Lock "cinder-e88682b1-d711-43ed-8628-a78aa5d18e10-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "cinder-36082dd2-bc39-4726-acdc-b5f4b84fc6ab-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Lock "cinder-36082dd2-bc39-4726-acdc-b5f4b84fc6ab-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "cinder-quobyte-36082dd2-bc39-4726-acdc-b5f4b84fc6ab" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Lock "cinder-quobyte-36082dd2-bc39-4726-acdc-b5f4b84fc6ab" acquired by "delete_volume" :: waited 0.018s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7619fd-eb76-4128-9be8-d8b29300ce32]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:11 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2880e767-ca15-49d3-b64c-f16303b9a2a4" returned: 0 in 1.047s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2880e767-ca15-49d3-b64c-f16303b9a2a4 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:11 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab Jun 25 18:16:11 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:11 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2880e767-ca15-49d3-b64c-f16303b9a2a4 Jun 25 18:16:11 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:12 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6" returned: 0 in 0.806s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:12 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.info Jun 25 18:16:12 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:12 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2880e767-ca15-49d3-b64c-f16303b9a2a4" returned: 0 in 0.752s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:12 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Lock "cinder-quobyte-2880e767-ca15-49d3-b64c-f16303b9a2a4" released by "delete_volume" :: held 1.874s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:12 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Created reservations ['c92af7fc-abd2-467f-bb00-838f19b3a040', '6a3e5e95-e41d-4e04-83aa-8cddd81167c7', 'd603bc23-8d44-43ef-a03d-9b1b15b3e784', 'fb188f8a-607c-467e-9bb5-9f1ba7080c9a'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:12 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab" returned: 0 in 1.252s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:12 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:16:12 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:13 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab Jun 25 18:16:13 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:13 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.info" returned: 0 in 0.969s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:13 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.info is being set with open permissions: ugo+rw Jun 25 18:16:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "cinder-4d038350-d54f-4e56-88fc-c843bd521b57-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:13 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.info Jun 25 18:16:13 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Lock "cinder-4d038350-d54f-4e56-88fc-c843bd521b57-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "cinder-quobyte-4d038350-d54f-4e56-88fc-c843bd521b57" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Lock "cinder-quobyte-4d038350-d54f-4e56-88fc-c843bd521b57" acquired by "delete_volume" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:13 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[8104c984-46df-4246-83a7-ebafc9c993bb]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d038350-d54f-4e56-88fc-c843bd521b57 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:13 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d038350-d54f-4e56-88fc-c843bd521b57 Jun 25 18:16:13 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:13 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_gzxv9xf9devstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8" returned: 0 in 2.698s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:13 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_gzxv9xf9devstack@QuobyteHD, size 112.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:16:13 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Converted 112.00 MB image at 41.50 MB/s Jun 25 18:16:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:13 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 1G Jun 25 18:16:13 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:13 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-36082dd2-bc39-4726-acdc-b5f4b84fc6ab" returned: 0 in 1.008s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Lock "cinder-quobyte-36082dd2-bc39-4726-acdc-b5f4b84fc6ab" released by "delete_volume" :: held 2.317s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:14 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.info" returned: 0 in 0.975s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.124s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:14 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ad05cb9b-ed7b-4200-8e92-8d715900a9ba tempest-VolumesDeleteCascade-1346204494 None] Create snapshot completed successfully Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Created reservations ['a1f1c2f9-c5e2-4bdc-a24d-9030a7ee9fd3', 'c5a749ea-9165-47fb-96fd-a66d4c26fdd7', 'd8ecb8a9-43c4-4124-8256-863072ec2d13', '5007c030-2964-470e-9509-54d582c685f8'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:14 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.303s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:14 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Deleted volume successfully. Jun 25 18:16:14 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:16:14 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d882e4d6-4489-421e-a177-ab1380b77d79 tempest-VolumesListTestJSON-1326046809 None] Lock "cinder-2880e767-ca15-49d3-b64c-f16303b9a2a4-delete_volume" released by "delete_volume" :: held 3.624s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:14 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d038350-d54f-4e56-88fc-c843bd521b57" returned: 0 in 1.087s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d038350-d54f-4e56-88fc-c843bd521b57 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:14 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d038350-d54f-4e56-88fc-c843bd521b57 Jun 25 18:16:14 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:14 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 1G" returned: 0 in 0.892s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca50db0b-a916-43a2-915c-85952cd6bf0e]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:14 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 Jun 25 18:16:14 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:14 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.745s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:14 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:14 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Deleted volume successfully. Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1dd23e30-a3b4-41aa-8c3f-46fa64f010cc tempest-AttachVolumeTestJSON-1368507731 None] Lock "cinder-36082dd2-bc39-4726-acdc-b5f4b84fc6ab-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:15 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4d038350-d54f-4e56-88fc-c843bd521b57" returned: 0 in 0.773s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Lock "cinder-quobyte-4d038350-d54f-4e56-88fc-c843bd521b57" released by "delete_volume" :: held 1.919s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Created reservations ['5df61786-d9d6-4fc0-8e70-03433ed975ff', 'b9f40e94-42f8-49d6-a1dc-78deb88c1265', '99a77ab0-2f46-4b88-bac1-56c1f2f6cbdc', '0837bd73-ef8c-4cfa-a532-6cdd8c9c5504'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:15 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:16:15 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "cinder-54ac0c87-843a-4adb-b0dd-c3358ab2465b-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Lock "cinder-54ac0c87-843a-4adb-b0dd-c3358ab2465b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:15 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8" returned: 0 in 1.033s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "cinder-quobyte-54ac0c87-843a-4adb-b0dd-c3358ab2465b" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Lock "cinder-quobyte-54ac0c87-843a-4adb-b0dd-c3358ab2465b" acquired by "delete_volume" :: waited 0.057s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dc22b4-b0d3-48fb-8e62-297c0b5eaee9]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:15 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 Jun 25 18:16:15 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:16 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b Jun 25 18:16:16 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Flow 'volume_create_manager' (9b58f3ab-aada-4334-aa30-06edb7044e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c30baaf0-7b70-4ff0-b03f-4d7062f23f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c30baaf0-7b70-4ff0-b03f-4d7062f23f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-195139294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6d0f11-abec-48fb-9ef1-e8f16a229c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a0c4a2db4cb41b38b67b0ab3a53f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d80e8584-b21f-44e7-a47d-6ca68dcf79e6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:16Z,use_quota=True,user_id='c53b58066700400bb03764ad3202ac34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60043859-71ec-4c2a-b3a5-af6767f4fd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60043859-71ec-4c2a-b3a5-af6767f4fd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df25985-833b-490f-8086-b86e3df33fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df25985-833b-490f-8086-b86e3df33fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fa6d0f11-abec-48fb-9ef1-e8f16a229c4a', 'volume_name': 'volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a', 'volume_size': 1, 'snapshot_id': 'd80e8584-b21f-44e7-a47d-6ca68dcf79e6'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5f40c3-c3bf-42e1-8edc-6415c85c6c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5f40c3-c3bf-42e1-8edc-6415c85c6c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2eec92-6faf-4be0-9236-14a5f4ea8d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:16 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Volume fa6d0f11-abec-48fb-9ef1-e8f16a229c4a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a', 'volume_size': 1, 'snapshot_id': 'd80e8584-b21f-44e7-a47d-6ca68dcf79e6'} Jun 25 18:16:16 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.125s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:16 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Deleted volume successfully. Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-quobyte-d80e8584-b21f-44e7-a47d-6ca68dcf79e6-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a" by "_create_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-d80e8584-b21f-44e7-a47d-6ca68dcf79e6-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Creating volume fa6d0f11-abec-48fb-9ef1-e8f16a229c4a from snapshot d80e8584-b21f-44e7-a47d-6ca68dcf79e6 {{(pid=93651) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-quobyte-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a" by "_copy_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-da39349c-0310-4a21-8093-9c1db316e0fa tempest-VolumesListTestJSON-1326046809 None] Lock "cinder-4d038350-d54f-4e56-88fc-c843bd521b57-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] snapshot: d80e8584-b21f-44e7-a47d-6ca68dcf79e6, volume: fa6d0f11-abec-48fb-9ef1-e8f16a229c4a, {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[79872380-7a2d-4765-9d1f-a56706d93fe8]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:16 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 Jun 25 18:16:16 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:17 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b" returned: 0 in 1.103s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:17 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8" returned: 1 in 1.355s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:16:17 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Downloaded image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c ((None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}])) to volume 24bbb7b1-ce69-4140-993b-44445a0e12f8 successfully. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:16:17 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Temporary image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c for user 77ae8efe0b9d4a08b8938d5e3edeb348 is deleted. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Marking volume 24bbb7b1-ce69-4140-993b-44445a0e12f8 as bootable. {{(pid=93651) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Copying metadata from image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c to 24bbb7b1-ce69-4140-993b-44445a0e12f8. {{(pid=93651) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Creating volume glance metadata for volume 24bbb7b1-ce69-4140-993b-44445a0e12f8 backed by image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93651) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7482852-5267-48fa-97d0-48ceaaa92255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24bbb7b1-ce69-4140-993b-44445a0e12f8', 'volume_size': 1, 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab240da4b4934e58a24c7f836ed62427', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'created_at': datetime.datetime(2026, 6, 25, 15, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 58, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7424bc3-bf3f-4cc8-9c06-7c9d7b4a299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:17 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Volume volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 (24bbb7b1-ce69-4140-993b-44445a0e12f8): created successfully Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7424bc3-bf3f-4cc8-9c06-7c9d7b4a299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Flow 'volume_create_manager' (d20d0cba-c562-46bf-8ffe-b709f3cc258e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:17 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-cf4db6c8-8bfa-420f-b25a-a6cdfdc8414c tempest-VolumesExtendTest-996162441 None] Created volume successfully. Jun 25 18:16:17 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6" returned: 0 in 0.992s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49df9f69-102f-4e36-8690-d7dc916d178e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] will copy from snapshot at /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Creating direct copy from snapshot {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a33511-101d-4c90-bcab-975ac83fc09b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:17 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e Jun 25 18:16:17 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:17 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-54ac0c87-843a-4adb-b0dd-c3358ab2465b" returned: 0 in 0.876s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Lock "cinder-quobyte-54ac0c87-843a-4adb-b0dd-c3358ab2465b" released by "delete_volume" :: held 2.088s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:18 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Created reservations ['3ef8f0cb-983f-4195-9fbe-b2c15815ad66', '5a47e261-e45d-4f6e-a63a-21322f74f3ca', '318d44c9-e7bd-4e14-accc-038a53f33755', 'a3824731-c647-498f-915e-2371d7686891'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:18 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:18 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:18 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:16:18 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-26b52335-d3dc-4289-a35d-9aae8212d160 tempest-VolumesExtendTest-996162441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:18 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e" returned: 0 in 1.000s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:18 devstack cinder-volume[93651]: DEBUG cinder.utils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Path /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a not found in is_blk_device check {{(pid=93651) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:16:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:18 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a Jun 25 18:16:18 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:19 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.910s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:19 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:19 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Deleted volume successfully. Jun 25 18:16:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f559c8cc-9186-4860-a507-51431e52dff0 tempest-VolumesListTestJSON-1326046809 None] Lock "cinder-54ac0c87-843a-4adb-b0dd-c3358ab2465b-delete_volume" released by "delete_volume" :: held 3.495s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:25 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a" returned: 0 in 6.963s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:25 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c7de33-905a-49c7-9042-868525129bde]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:25 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e Jun 25 18:16:25 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:26 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e" returned: 0 in 1.128s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:26 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Image conversion details: src /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e, size 1024.00 MB, duration 6.96 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:16:26 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Converted 1024.00 MB image at 147.05 MB/s Jun 25 18:16:26 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a is being set with open permissions: ugo+rw Jun 25 18:16:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:26 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a Jun 25 18:16:26 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:27 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a" returned: 0 in 0.820s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a" released by "_copy_volume_from_snapshot" :: held 11.089s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-d80e8584-b21f-44e7-a47d-6ca68dcf79e6-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a" released by "_create_volume_from_snapshot" :: held 11.146s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.171s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-26b52335-d3dc-4289-a35d-9aae8212d160 tempest-VolumesExtendTest-996162441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 9.105s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2eec92-6faf-4be0-9236-14a5f4ea8d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a', 'volume_size': 1, 'snapshot_id': 'd80e8584-b21f-44e7-a47d-6ca68dcf79e6'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c39ca4-0abf-4568-818c-d6d3e3910814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:27 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ccf770-7ed6-402b-aa5e-08bc03fef93f]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-26b52335-d3dc-4289-a35d-9aae8212d160 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:27 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Volume volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a (fa6d0f11-abec-48fb-9ef1-e8f16a229c4a): created successfully Jun 25 18:16:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c39ca4-0abf-4568-818c-d6d3e3910814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Flow 'volume_create_manager' (9b58f3ab-aada-4334-aa30-06edb7044e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:27 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-97555317-54e7-4c39-ac80-5e7bf8332c81 tempest-VolumesDeleteCascade-1346204494 None] Created volume successfully. Jun 25 18:16:27 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 Jun 25 18:16:27 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:28 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-26b52335-d3dc-4289-a35d-9aae8212d160 tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8" returned: 0 in 1.035s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-26b52335-d3dc-4289-a35d-9aae8212d160 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-49df9f69-102f-4e36-8690-d7dc916d178e-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-49df9f69-102f-4e36-8690-d7dc916d178e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:28 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Performing cascade delete. {{(pid=93651) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1025}} Jun 25 18:16:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-d80e8584-b21f-44e7-a47d-6ca68dcf79e6-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-d80e8584-b21f-44e7-a47d-6ca68dcf79e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-quobyte-49df9f69-102f-4e36-8690-d7dc916d178e" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:28 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 Jun 25 18:16:28 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-49df9f69-102f-4e36-8690-d7dc916d178e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-quobyte-d80e8584-b21f-44e7-a47d-6ca68dcf79e6" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-d80e8584-b21f-44e7-a47d-6ca68dcf79e6" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Deleting offline snapshot d80e8584-b21f-44e7-a47d-6ca68dcf79e6 of volume 49df9f69-102f-4e36-8690-d7dc916d178e {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:16:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] snapshot_file for this snap is: volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:16:29 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a635004-52ec-4ab2-8ad2-f720c85354f0]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:29 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 Jun 25 18:16:29 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:29 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-26b52335-d3dc-4289-a35d-9aae8212d160 tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8" returned: 1 in 1.025s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-26b52335-d3dc-4289-a35d-9aae8212d160 tempest-VolumesExtendTest-996162441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:16:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-26b52335-d3dc-4289-a35d-9aae8212d160 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 2G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-26b52335-d3dc-4289-a35d-9aae8212d160 tempest-VolumesExtendTest-996162441 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 2G" returned: 0 in 0.121s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-26b52335-d3dc-4289-a35d-9aae8212d160 tempest-VolumesExtendTest-996162441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.273s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:30 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-26b52335-d3dc-4289-a35d-9aae8212d160 tempest-VolumesExtendTest-996162441 None] Extend volume completed successfully. Jun 25 18:16:30 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6" returned: 0 in 1.065s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49df9f69-102f-4e36-8690-d7dc916d178e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:16:30 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3fb053-155e-42b2-96bf-fdd80d04e661]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:30 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e Jun 25 18:16:30 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:31 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e" returned: 0 in 1.087s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:31 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 Jun 25 18:16:31 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Acquiring lock "cinder-24bbb7b1-ce69-4140-993b-44445a0e12f8-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Lock "cinder-24bbb7b1-ce69-4140-993b-44445a0e12f8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Acquiring lock "cinder-quobyte-24bbb7b1-ce69-4140-993b-44445a0e12f8" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Lock "cinder-quobyte-24bbb7b1-ce69-4140-993b-44445a0e12f8" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:31 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e08b20-8520-43bf-adb0-6d4601142795]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:31 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 Jun 25 18:16:31 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:32 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6" returned: 0 in 1.001s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:32 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6 Jun 25 18:16:32 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8" returned: 0 in 1.040s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:32 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:33 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 Jun 25 18:16:33 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:33 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e.d80e8584-b21f-44e7-a47d-6ca68dcf79e6" returned: 0 in 0.943s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-d80e8584-b21f-44e7-a47d-6ca68dcf79e6" released by "_delete_snapshot" :: held 4.249s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-49df9f69-102f-4e36-8690-d7dc916d178e" released by "delete_snapshot" :: held 4.289s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:33 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Created reservations ['815e78ce-a6ab-42cc-be40-624968dcd105', 'a5c38aac-7785-4364-9444-a3c7c7041eb5', '1cd2ab9c-2dac-468e-b7c1-08fe74bc92ab', 'fa98848a-226c-4f68-b304-9a02a0e63d32'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:33 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Delete snapshot completed successfully. Jun 25 18:16:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-d80e8584-b21f-44e7-a47d-6ca68dcf79e6-delete_snapshot" released by "delete_snapshot" :: held 4.555s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Snapshots deleted, issuing volume delete {{(pid=93651) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1040}} Jun 25 18:16:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-quobyte-49df9f69-102f-4e36-8690-d7dc916d178e" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-49df9f69-102f-4e36-8690-d7dc916d178e" acquired by "delete_volume" :: waited 0.016s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:33 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccaa006-fff1-4c8b-b984-75fa39b9910f]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:33 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e Jun 25 18:16:33 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:34 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8" returned: 1 in 1.459s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:16:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:34 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8 Jun 25 18:16:34 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:34 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e" returned: 0 in 1.235s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:34 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e Jun 25 18:16:34 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-24bbb7b1-ce69-4140-993b-44445a0e12f8" returned: 0 in 1.156s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:35 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Lock "cinder-quobyte-24bbb7b1-ce69-4140-993b-44445a0e12f8" released by "delete_volume" :: held 3.758s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:35 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Created reservations ['7b1b6c7f-1ab5-46fa-91dd-1d19f6b8545d', 'a213c479-9068-44b6-85e4-29b003de0187', '2be97b18-7cec-4015-9687-6d13cfe31e8d', '08d8d3ea-761f-4381-be8e-071e10f2b50d'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:35 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:16:35 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:35 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-49df9f69-102f-4e36-8690-d7dc916d178e" returned: 0 in 1.088s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-49df9f69-102f-4e36-8690-d7dc916d178e" released by "delete_volume" :: held 2.419s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:36 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Created reservations ['b5d07d31-ed11-4892-9798-9ca1846a523a', 'a427d12e-7178-492f-b69d-253740d1ea79', 'fb468012-279b-4bf8-a9b8-732b17c71f06', '278e3186-7d8a-448b-b6cf-ebe461234432'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:36 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:16:36 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:36 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.252s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:36 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:36 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Deleted volume successfully. Jun 25 18:16:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-012bec65-651f-4750-b58f-1de7523fa590 tempest-VolumesExtendTest-996162441 None] Lock "cinder-24bbb7b1-ce69-4140-993b-44445a0e12f8-delete_volume" released by "delete_volume" :: held 5.445s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "cinder-quobyte-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a" acquired by "delete_volume" :: waited 0.038s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8659d2-0795-4ad0-a229-ffd243353059]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:37 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a Jun 25 18:16:37 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:37 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.414s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Flow 'volume_create_manager' (f304baa0-926e-4120-9f28-7fd6d071604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b60ca6-cbaa-4892-b7ad-0e6d6b960548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:37 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Deleted volume successfully. Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b60ca6-cbaa-4892-b7ad-0e6d6b960548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-334449666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4e027d-2146-43c4-824a-d3499fd3454f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c999483494147818e4ced9bb1d51cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:38Z,use_quota=True,user_id='77ae8efe0b9d4a08b8938d5e3edeb348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d80942-1011-479a-b5b7-b36942996849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d80942-1011-479a-b5b7-b36942996849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6240567-84a2-4693-9c84-ada9beb2e00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6240567-84a2-4693-9c84-ada9beb2e00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4e027d-2146-43c4-824a-d3499fd3454f', 'volume_name': 'volume-ee4e027d-2146-43c4-824a-d3499fd3454f', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6f28e2-1f50-4d42-8911-d7af5d1424d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6f28e2-1f50-4d42-8911-d7af5d1424d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a358c673-4f16-477b-943d-d3fb520cf673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:37 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Volume ee4e027d-2146-43c4-824a-d3499fd3454f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4e027d-2146-43c4-824a-d3499fd3454f', 'volume_size': 1} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-334449666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4e027d-2146-43c4-824a-d3499fd3454f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c999483494147818e4ced9bb1d51cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:38Z,use_quota=True,user_id='77ae8efe0b9d4a08b8938d5e3edeb348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Creating volume ee4e027d-2146-43c4-824a-d3499fd3454f {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:37 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f0233fe0-b4e2-444d-91f2-efda1f73455e tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-49df9f69-102f-4e36-8690-d7dc916d178e-delete_volume" released by "delete_volume" :: held 8.996s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:37 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f 1073741824 Jun 25 18:16:37 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:38 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a" returned: 0 in 1.217s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:38 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a Jun 25 18:16:38 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:16:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:39 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f 1073741824" returned: 0 in 1.544s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:39 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:16:39 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:39 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f Jun 25 18:16:39 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:39 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a" returned: 0 in 1.255s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:39 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-quobyte-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a" released by "delete_volume" :: held 2.561s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Created reservations ['2d09329e-6504-4b93-ade3-c77fb5bf1639', '55be4760-9fb9-42d7-bc17-d483fe351284', '806008c5-95fc-428e-bdfe-9b78ddffbf04', 'cced4c5d-bb35-4d24-97f3-06feac8825ad'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:40 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:16:40 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:40 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f" returned: 0 in 1.211s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] <== create_volume: return (2855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.862s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a358c673-4f16-477b-943d-d3fb520cf673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4e027d-2146-43c4-824a-d3499fd3454f', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d984177-13b3-47c4-8705-0da2fbf49749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:40 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Volume volume-ee4e027d-2146-43c4-824a-d3499fd3454f (ee4e027d-2146-43c4-824a-d3499fd3454f): created successfully Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d984177-13b3-47c4-8705-0da2fbf49749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Flow 'volume_create_manager' (f304baa0-926e-4120-9f28-7fd6d071604a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:40 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f7d1d627-8843-4b1d-b844-499cfec379ec tempest-VolumesExtendTest-996162441 None] Created volume successfully. Jun 25 18:16:40 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.538s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 28 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:16:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:16:41 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.090s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:41 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:41 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Deleted volume successfully. Jun 25 18:16:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e0035a9b-1da0-40b5-96db-1971638df411 tempest-VolumesDeleteCascade-1346204494 None] Lock "cinder-fa6d0f11-abec-48fb-9ef1-e8f16a229c4a-delete_volume" released by "delete_volume" :: held 4.123s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Flow 'volume_create_manager' (93785add-e98e-4ba6-a6b0-4264d51639d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4c6d6c-d856-4958-9151-db2f64557428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] Creating offline snapshot 16b2b13a-8548-4b36-8382-06da7e7476dd of volume ee4e027d-2146-43c4-824a-d3499fd3454f {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4c6d6c-d856-4958-9151-db2f64557428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1235119260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e7e860-d255-4276-b689-306f9e519ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d953702ac8c45a3867b9671437f1df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:42Z,use_quota=True,user_id='e753c8db2553449caea190d53679168f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9149e209-3de5-4c78-939e-92765182d69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9149e209-3de5-4c78-939e-92765182d69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f60d508-92dc-488e-9992-9f2233e7b042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f60d508-92dc-488e-9992-9f2233e7b042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e7e860-d255-4276-b689-306f9e519ccd', 'volume_name': 'volume-22e7e860-d255-4276-b689-306f9e519ccd', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d539b39d-8b35-478f-b1a0-521b6f6bcc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d539b39d-8b35-478f-b1a0-521b6f6bcc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7efb4ace-9fcc-4c68-bccb-7d1448528414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:42 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Volume 22e7e860-d255-4276-b689-306f9e519ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e7e860-d255-4276-b689-306f9e519ccd', 'volume_size': 1} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4176a36-cd7f-49c4-b94e-1d3e54b0ab04]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:42 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f Jun 25 18:16:42 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:43 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f" returned: 0 in 0.980s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:43 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd 1G Jun 25 18:16:43 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:44 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd 1G" returned: 0 in 1.093s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e027d-2146-43c4-824a-d3499fd3454f -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:44 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e027d-2146-43c4-824a-d3499fd3454f -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd Jun 25 18:16:44 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:45 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e027d-2146-43c4-824a-d3499fd3454f -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd" returned: 0 in 0.917s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:45 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd is being set with open permissions: ugo+rw Jun 25 18:16:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:45 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd Jun 25 18:16:45 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:46 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd" returned: 0 in 0.894s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:46 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:INSERT=39,cinder:UPDATE=141,cinder:SELECT=113,cinder:DELETE=13 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:16:46 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=121,cinder:UPDATE=151,cinder:INSERT=43,cinder:DELETE=9 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:16:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:46 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.info Jun 25 18:16:46 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:47 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Flow 'volume_create_manager' (f1d92ad2-f151-4454-9bc4-18ae835261e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1943fb4-6d31-4664-93ff-30da7e7084ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1943fb4-6d31-4664-93ff-30da7e7084ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1909870155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cce349f-512c-45ec-84c6-010479371bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c08c7c771d491892e1ad729dea9a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:47Z,use_quota=True,user_id='399e3304bd8349bd8557e2a5b4a28f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718439ad-379f-4db9-870f-c3f1408de877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718439ad-379f-4db9-870f-c3f1408de877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d86ecc8-ddbf-4579-8cfc-bae99a7a608d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d86ecc8-ddbf-4579-8cfc-bae99a7a608d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cce349f-512c-45ec-84c6-010479371bfb', 'volume_name': 'volume-9cce349f-512c-45ec-84c6-010479371bfb', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36636b92-6dec-4607-a37d-040a061f3ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36636b92-6dec-4607-a37d-040a061f3ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8225355-bfb9-4b03-abf8-46b89e53d499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:47 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Volume 9cce349f-512c-45ec-84c6-010479371bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cce349f-512c-45ec-84c6-010479371bfb', 'volume_size': 1} Jun 25 18:16:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:47 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.info" returned: 0 in 0.887s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:47 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.info is being set with open permissions: ugo+rw Jun 25 18:16:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:47 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.info Jun 25 18:16:47 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:48 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.info" returned: 0 in 0.682s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.668s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.537s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1235119260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e7e860-d255-4276-b689-306f9e519ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d953702ac8c45a3867b9671437f1df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:42Z,use_quota=True,user_id='e753c8db2553449caea190d53679168f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:16:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Creating volume 22e7e860-d255-4276-b689-306f9e519ccd {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:16:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:48 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:16:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:48 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd 1073741824 Jun 25 18:16:48 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:48 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-23a5810e-6e80-4210-a97f-b35bf0981303 tempest-VolumesExtendTest-996162441 None] Create snapshot completed successfully Jun 25 18:16:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7771b3db-3a3f-476d-90b8-b2eb0d8c4716 tempest-VolumesExtendTest-996162441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:49 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd 1073741824" returned: 0 in 1.013s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:49 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd Jun 25 18:16:49 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:49 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd" returned: 0 in 0.792s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.747s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1909870155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cce349f-512c-45ec-84c6-010479371bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c08c7c771d491892e1ad729dea9a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:47Z,use_quota=True,user_id='399e3304bd8349bd8557e2a5b4a28f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Creating volume 9cce349f-512c-45ec-84c6-010479371bfb {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:49 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9cce349f-512c-45ec-84c6-010479371bfb 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:49 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9cce349f-512c-45ec-84c6-010479371bfb 1073741824 Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7efb4ace-9fcc-4c68-bccb-7d1448528414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e7e860-d255-4276-b689-306f9e519ccd', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:49 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb86f9b5-4eab-4c66-a789-92c9e9e6e9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:49 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Volume volume-22e7e860-d255-4276-b689-306f9e519ccd (22e7e860-d255-4276-b689-306f9e519ccd): created successfully Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb86f9b5-4eab-4c66-a789-92c9e9e6e9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Flow 'volume_create_manager' (93785add-e98e-4ba6-a6b0-4264d51639d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:50 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f0e69022-a888-442c-b693-28c297d0400f tempest-VolumesSnapshotTestJSON-511404840 None] Created volume successfully. Jun 25 18:16:50 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Flow 'volume_create_manager' (4431fd44-c4dd-482e-b7f7-e0be154acdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c16dde3-d675-4010-b1b4-fa76d94a8d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c16dde3-d675-4010-b1b4-fa76d94a8d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-865193307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23809d49-c0a2-42f9-a757-55176ab7c166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd93899ad95a413493535107e89a74b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:50Z,use_quota=True,user_id='8e5d188a75eb47988d2cf7a0537eb627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e30e83-d1d6-4dfc-966d-8b2fd59fff53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e30e83-d1d6-4dfc-966d-8b2fd59fff53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f06b56-f791-4a87-851f-ed82c396997f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f06b56-f791-4a87-851f-ed82c396997f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23809d49-c0a2-42f9-a757-55176ab7c166', 'volume_name': 'volume-23809d49-c0a2-42f9-a757-55176ab7c166', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60fe638-6f34-42fe-97d5-2334d8792d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60fe638-6f34-42fe-97d5-2334d8792d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7fa101-362a-4ee3-bd26-39862d95603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:50 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Volume 23809d49-c0a2-42f9-a757-55176ab7c166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23809d49-c0a2-42f9-a757-55176ab7c166', 'volume_size': 1} Jun 25 18:16:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:50 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9cce349f-512c-45ec-84c6-010479371bfb 1073741824" returned: 0 in 0.934s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9cce349f-512c-45ec-84c6-010479371bfb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:50 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9cce349f-512c-45ec-84c6-010479371bfb Jun 25 18:16:50 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:51 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9cce349f-512c-45ec-84c6-010479371bfb" returned: 0 in 0.664s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:51 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:16:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7771b3db-3a3f-476d-90b8-b2eb0d8c4716 tempest-VolumesExtendTest-996162441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.701s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:51 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfddc5cf-1174-44c8-b87c-2cf008a46b97]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7771b3db-3a3f-476d-90b8-b2eb0d8c4716 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8225355-bfb9-4b03-abf8-46b89e53d499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cce349f-512c-45ec-84c6-010479371bfb', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54c77f9-831e-4f84-b630-38d5761095ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:51 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Volume volume-9cce349f-512c-45ec-84c6-010479371bfb (9cce349f-512c-45ec-84c6-010479371bfb): created successfully Jun 25 18:16:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54c77f9-831e-4f84-b630-38d5761095ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Flow 'volume_create_manager' (f1d92ad2-f151-4454-9bc4-18ae835261e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:51 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4d6791d7-1332-43c2-88b4-7af46b748784 tempest-VolumesTransfersV355Test-1732440957 None] Created volume successfully. Jun 25 18:16:51 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f Jun 25 18:16:51 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:52 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7771b3db-3a3f-476d-90b8-b2eb0d8c4716 tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f" returned: 0 in 0.852s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7771b3db-3a3f-476d-90b8-b2eb0d8c4716 tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd 2G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7771b3db-3a3f-476d-90b8-b2eb0d8c4716 tempest-VolumesExtendTest-996162441 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd 2G" returned: 0 in 0.149s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7771b3db-3a3f-476d-90b8-b2eb0d8c4716 tempest-VolumesExtendTest-996162441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.033s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.952s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-865193307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23809d49-c0a2-42f9-a757-55176ab7c166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd93899ad95a413493535107e89a74b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:50Z,use_quota=True,user_id='8e5d188a75eb47988d2cf7a0537eb627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:16:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Creating volume 23809d49-c0a2-42f9-a757-55176ab7c166 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:16:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:52 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:16:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-23809d49-c0a2-42f9-a757-55176ab7c166 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:52 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-23809d49-c0a2-42f9-a757-55176ab7c166 1073741824 Jun 25 18:16:52 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:52 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7771b3db-3a3f-476d-90b8-b2eb0d8c4716 tempest-VolumesExtendTest-996162441 None] Extend volume completed successfully. Jun 25 18:16:53 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-376eb539-74e2-4f9a-acda-7b4782643be2 tempest-VolumesTransfersV355Test-487523327 None] Transfer volume completed successfully. Jun 25 18:16:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Acquiring lock "cinder-16b2b13a-8548-4b36-8382-06da7e7476dd-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Lock "cinder-16b2b13a-8548-4b36-8382-06da7e7476dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Acquiring lock "cinder-quobyte-ee4e027d-2146-43c4-824a-d3499fd3454f" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Lock "cinder-quobyte-ee4e027d-2146-43c4-824a-d3499fd3454f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Acquiring lock "cinder-quobyte-16b2b13a-8548-4b36-8382-06da7e7476dd" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Lock "cinder-quobyte-16b2b13a-8548-4b36-8382-06da7e7476dd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Deleting offline snapshot 16b2b13a-8548-4b36-8382-06da7e7476dd of volume ee4e027d-2146-43c4-824a-d3499fd3454f {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:16:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] snapshot_file for this snap is: volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:16:53 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e305ce2-d364-442c-8e2d-e623623e6a3a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:53 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-23809d49-c0a2-42f9-a757-55176ab7c166 1073741824" returned: 0 in 1.014s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:53 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd Jun 25 18:16:53 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-23809d49-c0a2-42f9-a757-55176ab7c166 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:53 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-23809d49-c0a2-42f9-a757-55176ab7c166 Jun 25 18:16:53 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Acquiring lock "cinder-9cce349f-512c-45ec-84c6-010479371bfb-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Lock "cinder-9cce349f-512c-45ec-84c6-010479371bfb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Acquiring lock "cinder-quobyte-9cce349f-512c-45ec-84c6-010479371bfb" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Lock "cinder-quobyte-9cce349f-512c-45ec-84c6-010479371bfb" acquired by "delete_volume" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4436e591-d6ec-435b-9700-a7fa8472faa2]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9cce349f-512c-45ec-84c6-010479371bfb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:54 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-23809d49-c0a2-42f9-a757-55176ab7c166" returned: 0 in 0.703s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.130s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7fa101-362a-4ee3-bd26-39862d95603b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23809d49-c0a2-42f9-a757-55176ab7c166', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:54 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9cce349f-512c-45ec-84c6-010479371bfb Jun 25 18:16:54 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81cef9df-49f9-4d4e-aad1-87ce1dc4b204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] Creating offline snapshot 50dddd1c-6bc3-401c-bbad-fee90ecdaceb of volume 22e7e860-d255-4276-b689-306f9e519ccd {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:16:54 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Volume volume-23809d49-c0a2-42f9-a757-55176ab7c166 (23809d49-c0a2-42f9-a757-55176ab7c166): created successfully Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81cef9df-49f9-4d4e-aad1-87ce1dc4b204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Flow 'volume_create_manager' (4431fd44-c4dd-482e-b7f7-e0be154acdbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[16875374-29a9-484f-bc6c-d4281f1fc9ae]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:54 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd" returned: 0 in 1.017s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4e027d-2146-43c4-824a-d3499fd3454f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:16:54 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-b1cae071-ebb7-4a7c-bba7-e11568bed3ac tempest-VolumeQuotasAdminTestJSON-726554266 None] Created volume successfully. Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b41c75f-164e-47d7-b226-81baf09255ec]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:54 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd Jun 25 18:16:54 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:54 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f Jun 25 18:16:54 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Acquiring lock "cinder-23809d49-c0a2-42f9-a757-55176ab7c166-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:54 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Lock "cinder-23809d49-c0a2-42f9-a757-55176ab7c166-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:55 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Acquiring lock "cinder-quobyte-23809d49-c0a2-42f9-a757-55176ab7c166" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:55 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Lock "cinder-quobyte-23809d49-c0a2-42f9-a757-55176ab7c166" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:55 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[20902af4-5133-4ad9-95b5-51a6fd555f42]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-23809d49-c0a2-42f9-a757-55176ab7c166 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:55 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9cce349f-512c-45ec-84c6-010479371bfb" returned: 0 in 0.950s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9cce349f-512c-45ec-84c6-010479371bfb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:55 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-23809d49-c0a2-42f9-a757-55176ab7c166 Jun 25 18:16:55 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:55 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9cce349f-512c-45ec-84c6-010479371bfb Jun 25 18:16:55 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:55 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd" returned: 0 in 0.951s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:55 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb 1G Jun 25 18:16:55 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:55 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f" returned: 0 in 1.039s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:55 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd Jun 25 18:16:55 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:56 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9cce349f-512c-45ec-84c6-010479371bfb" returned: 0 in 0.773s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Lock "cinder-quobyte-9cce349f-512c-45ec-84c6-010479371bfb" released by "delete_volume" :: held 1.794s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Created reservations ['78c7a416-f28b-4ae3-930f-72fe1ceba731', '4672fccc-76bb-488d-b7ee-9ccf4c9887fb', '50f26e8f-8db1-42f0-9736-579253de7eba', 'dfe67fdf-041a-4ffa-9143-cf08a9e1c2ff'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:56 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-23809d49-c0a2-42f9-a757-55176ab7c166" returned: 0 in 1.023s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-23809d49-c0a2-42f9-a757-55176ab7c166 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:56 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-23809d49-c0a2-42f9-a757-55176ab7c166 Jun 25 18:16:56 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:56 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:16:56 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb 1G" returned: 0 in 1.011s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e7e860-d255-4276-b689-306f9e519ccd -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:56 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:56 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e7e860-d255-4276-b689-306f9e519ccd -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb Jun 25 18:16:56 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:56 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd" returned: 0 in 1.041s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:56 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd Jun 25 18:16:56 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:57 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-23809d49-c0a2-42f9-a757-55176ab7c166" returned: 0 in 0.895s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Lock "cinder-quobyte-23809d49-c0a2-42f9-a757-55176ab7c166" released by "delete_volume" :: held 1.981s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Created reservations ['bfc8248a-417c-4aa8-9569-8699bd3f95c2', 'e99e8226-8470-42ae-aee9-08b9d867bc80', 'e42f11e0-a249-417c-8b74-568c2b6f7378', '59a66618-a22f-4e80-8297-155f55f21e60'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:57 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.940s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:57 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Deleted volume successfully. Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Flow 'volume_create_manager' (39c38b36-f46c-430a-affd-4376771c4204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ca831f-c33f-4afd-939c-8a38990be7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-42835ece-247f-42ba-9289-f1db427c6ac9 tempest-VolumesTransfersV355Test-1435661328 None] Lock "cinder-9cce349f-512c-45ec-84c6-010479371bfb-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ca831f-c33f-4afd-939c-8a38990be7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-823714104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044b2190-df0f-4467-b1b3-92aa3efd0887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c08c7c771d491892e1ad729dea9a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:57Z,use_quota=True,user_id='399e3304bd8349bd8557e2a5b4a28f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bfbbd3-2c3e-4542-8cd9-cada75aeb9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bfbbd3-2c3e-4542-8cd9-cada75aeb9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59dc2fda-bed9-4592-a5e6-8b88f4aa7360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59dc2fda-bed9-4592-a5e6-8b88f4aa7360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '044b2190-df0f-4467-b1b3-92aa3efd0887', 'volume_name': 'volume-044b2190-df0f-4467-b1b3-92aa3efd0887', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a9ba34-f808-4329-b972-d540b4f4eb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a9ba34-f808-4329-b972-d540b4f4eb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b0250d-c39a-4cfe-9bbd-49c46b52c97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:57 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Volume 044b2190-df0f-4467-b1b3-92aa3efd0887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-044b2190-df0f-4467-b1b3-92aa3efd0887', 'volume_size': 1} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:57 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:16:57 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:57 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e7e860-d255-4276-b689-306f9e519ccd -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb" returned: 0 in 0.989s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:57 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb is being set with open permissions: ugo+rw Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:57 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb Jun 25 18:16:57 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:57 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f.16b2b13a-8548-4b36-8382-06da7e7476dd" returned: 0 in 0.992s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Lock "cinder-quobyte-16b2b13a-8548-4b36-8382-06da7e7476dd" released by "_delete_snapshot" :: held 4.214s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Lock "cinder-quobyte-ee4e027d-2146-43c4-824a-d3499fd3454f" released by "delete_snapshot" :: held 4.246s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Created reservations ['93306fb4-0454-44b0-979a-495967941fd4', '1d158b10-e8fa-425f-8e81-26d515fd2bfe', '5afc8372-c4a1-4f0e-a989-ed89329a1490', '75b8a6fd-80ca-4341-8d5e-8383467b49c3'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:16:57 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Delete snapshot completed successfully. Jun 25 18:16:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f54e6df9-cc4b-44e4-9b38-36437281ff1e tempest-VolumesExtendTest-996162441 None] Lock "cinder-16b2b13a-8548-4b36-8382-06da7e7476dd-delete_snapshot" released by "delete_snapshot" :: held 4.403s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:58 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.722s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:16:58 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Deleted volume successfully. Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9ee282ba-085c-4579-9eca-cd082fce59f9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Lock "cinder-23809d49-c0a2-42f9-a757-55176ab7c166-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:16:58 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb" returned: 0 in 0.724s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:58 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.info Jun 25 18:16:58 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Acquiring lock "cinder-ee4e027d-2146-43c4-824a-d3499fd3454f-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Lock "cinder-ee4e027d-2146-43c4-824a-d3499fd3454f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:58 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.info" returned: 0 in 0.690s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:58 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.info is being set with open permissions: ugo+rw Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Acquiring lock "cinder-quobyte-ee4e027d-2146-43c4-824a-d3499fd3454f" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:16:58 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.info Jun 25 18:16:58 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Flow 'volume_create_manager' (acb6333c-0eb3-4a3d-9750-5fb17c5a12e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05b9a97-f687-4c42-9231-713e25da0093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Lock "cinder-quobyte-ee4e027d-2146-43c4-824a-d3499fd3454f" acquired by "delete_volume" :: waited 0.045s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05b9a97-f687-4c42-9231-713e25da0093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2032906965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d216a7-b824-4098-b8b9-71102d703b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd93899ad95a413493535107e89a74b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:59Z,use_quota=True,user_id='8e5d188a75eb47988d2cf7a0537eb627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11eb844-2ec9-48e6-b0b0-43173c85b44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11eb844-2ec9-48e6-b0b0-43173c85b44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd73ce84-da88-4397-993c-8229d3448761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd73ce84-da88-4397-993c-8229d3448761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d216a7-b824-4098-b8b9-71102d703b95', 'volume_name': 'volume-c5d216a7-b824-4098-b8b9-71102d703b95', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf140545-2353-4114-bd2d-a076a88b1956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf140545-2353-4114-bd2d-a076a88b1956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2108f5f3-61fb-4414-a1f6-7ec7da287c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:16:59 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Volume c5d216a7-b824-4098-b8b9-71102d703b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d216a7-b824-4098-b8b9-71102d703b95', 'volume_size': 1} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e654b500-cb65-481a-8dc4-3b6370a66cbb]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:59 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f Jun 25 18:16:59 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:59 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.info" returned: 0 in 0.641s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.136s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.204s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-823714104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044b2190-df0f-4467-b1b3-92aa3efd0887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35c08c7c771d491892e1ad729dea9a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:57Z,use_quota=True,user_id='399e3304bd8349bd8557e2a5b4a28f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Creating volume 044b2190-df0f-4467-b1b3-92aa3efd0887 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:16:59 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-044b2190-df0f-4467-b1b3-92aa3efd0887 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:59 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-044b2190-df0f-4467-b1b3-92aa3efd0887 1073741824 Jun 25 18:16:59 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:16:59 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-8739d984-3e22-47e4-9ab8-8900fa6af1f4 tempest-VolumesSnapshotTestJSON-511404840 None] Create snapshot completed successfully Jun 25 18:16:59 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f" returned: 0 in 0.784s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:16:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:16:59 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f Jun 25 18:16:59 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:00 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-044b2190-df0f-4467-b1b3-92aa3efd0887 1073741824" returned: 0 in 0.880s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-044b2190-df0f-4467-b1b3-92aa3efd0887 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:00 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-044b2190-df0f-4467-b1b3-92aa3efd0887 Jun 25 18:17:00 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:00 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ee4e027d-2146-43c4-824a-d3499fd3454f" returned: 0 in 0.722s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Lock "cinder-quobyte-ee4e027d-2146-43c4-824a-d3499fd3454f" released by "delete_volume" :: held 1.621s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Created reservations ['232e381b-5309-4361-9a9b-4fae812fb059', '147bfa13-d2e8-42e4-92b0-d3a3ddf4db95', 'deffea8c-0058-446d-b02d-9c1aab2aeb72', '65e974ac-d233-4059-a8ae-5a1cc69e04f1'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:00 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:17:00 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-50dddd1c-6bc3-401c-bbad-fee90ecdaceb-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-50dddd1c-6bc3-401c-bbad-fee90ecdaceb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-22e7e860-d255-4276-b689-306f9e519ccd" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-22e7e860-d255-4276-b689-306f9e519ccd" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-50dddd1c-6bc3-401c-bbad-fee90ecdaceb" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-50dddd1c-6bc3-401c-bbad-fee90ecdaceb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Deleting offline snapshot 50dddd1c-6bc3-401c-bbad-fee90ecdaceb of volume 22e7e860-d255-4276-b689-306f9e519ccd {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] snapshot_file for this snap is: volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[3326b191-3975-4ce3-b090-c362b99132b1]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:01 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb Jun 25 18:17:01 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:01 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-044b2190-df0f-4467-b1b3-92aa3efd0887" returned: 0 in 0.918s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.380s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2032906965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d216a7-b824-4098-b8b9-71102d703b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd93899ad95a413493535107e89a74b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:16:59Z,use_quota=True,user_id='8e5d188a75eb47988d2cf7a0537eb627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Creating volume c5d216a7-b824-4098-b8b9-71102d703b95 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:17:01 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c5d216a7-b824-4098-b8b9-71102d703b95 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:01 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c5d216a7-b824-4098-b8b9-71102d703b95 1073741824 Jun 25 18:17:01 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b0250d-c39a-4cfe-9bbd-49c46b52c97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-044b2190-df0f-4467-b1b3-92aa3efd0887', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a226a9-98cd-4c14-924b-8eb81d84ab16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:01 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Volume volume-044b2190-df0f-4467-b1b3-92aa3efd0887 (044b2190-df0f-4467-b1b3-92aa3efd0887): created successfully Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a226a9-98cd-4c14-924b-8eb81d84ab16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Flow 'volume_create_manager' (39c38b36-f46c-430a-affd-4376771c4204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:01 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-135cdcc2-4cd0-4add-bc8f-a277e29b42d1 tempest-VolumesTransfersV355Test-1732440957 None] Created volume successfully. Jun 25 18:17:01 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.982s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:01 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Deleted volume successfully. Jun 25 18:17:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3238412e-afc5-43db-9957-4923cc14e23d tempest-VolumesExtendTest-996162441 None] Lock "cinder-ee4e027d-2146-43c4-824a-d3499fd3454f-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:02 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb" returned: 0 in 1.045s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22e7e860-d255-4276-b689-306f9e519ccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:17:02 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5546c5-f6de-4854-a4f0-6347c7638f40]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:02 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd Jun 25 18:17:02 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:02 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c5d216a7-b824-4098-b8b9-71102d703b95 1073741824" returned: 0 in 1.220s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c5d216a7-b824-4098-b8b9-71102d703b95 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:02 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c5d216a7-b824-4098-b8b9-71102d703b95 Jun 25 18:17:02 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Acquiring lock "cinder-044b2190-df0f-4467-b1b3-92aa3efd0887-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Lock "cinder-044b2190-df0f-4467-b1b3-92aa3efd0887-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Acquiring lock "cinder-quobyte-044b2190-df0f-4467-b1b3-92aa3efd0887" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Lock "cinder-quobyte-044b2190-df0f-4467-b1b3-92aa3efd0887" acquired by "delete_volume" :: waited 0.044s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:03 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4679a971-32a8-4b60-8e48-8296a1d3c856]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-044b2190-df0f-4467-b1b3-92aa3efd0887 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:03 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-044b2190-df0f-4467-b1b3-92aa3efd0887 Jun 25 18:17:03 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:03 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd" returned: 0 in 1.298s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:03 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb Jun 25 18:17:03 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:03 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c5d216a7-b824-4098-b8b9-71102d703b95" returned: 0 in 1.107s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] <== create_volume: return (2410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:17:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.414s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2108f5f3-61fb-4414-a1f6-7ec7da287c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d216a7-b824-4098-b8b9-71102d703b95', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770937d7-6884-4ed9-a6d9-5dda326190c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:03 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Volume volume-c5d216a7-b824-4098-b8b9-71102d703b95 (c5d216a7-b824-4098-b8b9-71102d703b95): created successfully Jun 25 18:17:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770937d7-6884-4ed9-a6d9-5dda326190c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Flow 'volume_create_manager' (acb6333c-0eb3-4a3d-9750-5fb17c5a12e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:03 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-8140ea95-f9ba-4d2a-a1f1-8e3e2b16b3c9 tempest-VolumeQuotasAdminTestJSON-726554266 None] Created volume successfully. Jun 25 18:17:04 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-044b2190-df0f-4467-b1b3-92aa3efd0887" returned: 0 in 1.059s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-044b2190-df0f-4467-b1b3-92aa3efd0887 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:04 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-044b2190-df0f-4467-b1b3-92aa3efd0887 Jun 25 18:17:04 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:04 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb" returned: 0 in 1.133s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:04 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb Jun 25 18:17:04 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:05 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-044b2190-df0f-4467-b1b3-92aa3efd0887" returned: 0 in 1.158s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Lock "cinder-quobyte-044b2190-df0f-4467-b1b3-92aa3efd0887" released by "delete_volume" :: held 2.315s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:05 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-83223388-86a8-4b64-a67a-430f6bf48f26 tempest-VolumeQuotasAdminTestJSON-1277092652 None] Transfer volume completed successfully. Jun 25 18:17:05 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Created reservations ['b8371a3b-0fb4-4fbf-bd01-f57aa10f6e07', '79386638-9186-4200-a7cf-065bf61e6622', '625e69a7-1543-496d-bd2b-2d0f2429b400', '13244416-0715-4558-a86b-a17fd2f1dc90'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:05 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:17:05 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:05 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd.50dddd1c-6bc3-401c-bbad-fee90ecdaceb" returned: 0 in 1.160s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-50dddd1c-6bc3-401c-bbad-fee90ecdaceb" released by "_delete_snapshot" :: held 4.802s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-22e7e860-d255-4276-b689-306f9e519ccd" released by "delete_snapshot" :: held 4.835s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:05 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Created reservations ['2d834a8a-9c1b-48b7-bc81-ab7f7e05e4fe', 'f8b58654-8b92-4928-a195-860e9624a0ce', 'c3a67b61-cde9-476c-9c12-e0db4a03ee51', '5d059e7f-9f7a-4b9d-853f-6ea5eda49078'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:06 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Delete snapshot completed successfully. Jun 25 18:17:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3dd84f70-be2c-45ae-9c77-527e21eaa836 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-50dddd1c-6bc3-401c-bbad-fee90ecdaceb-delete_snapshot" released by "delete_snapshot" :: held 5.123s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:06 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.950s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:06 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:06 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Deleted volume successfully. Jun 25 18:17:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b81ac325-d0b4-4f71-9dad-7edc391a1167 tempest-VolumesTransfersV355Test-1435661328 None] Lock "cinder-044b2190-df0f-4467-b1b3-92aa3efd0887-delete_volume" released by "delete_volume" :: held 3.632s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Acquiring lock "cinder-c5d216a7-b824-4098-b8b9-71102d703b95-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Lock "cinder-c5d216a7-b824-4098-b8b9-71102d703b95-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Acquiring lock "cinder-quobyte-c5d216a7-b824-4098-b8b9-71102d703b95" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Lock "cinder-quobyte-c5d216a7-b824-4098-b8b9-71102d703b95" acquired by "delete_volume" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c151f3d-8fcf-47a6-bbb0-d30176b6586c]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c5d216a7-b824-4098-b8b9-71102d703b95 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:07 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c5d216a7-b824-4098-b8b9-71102d703b95 Jun 25 18:17:07 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Flow 'volume_create_manager' (ea452399-986a-440c-8030-c5d24b63c88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f64e69b-abcc-48e4-8d62-1492f8f6f7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f64e69b-abcc-48e4-8d62-1492f8f6f7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-880815523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b7a036-b255-4f63-a7e3-ecfeb7387b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d953702ac8c45a3867b9671437f1df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:08Z,use_quota=True,user_id='e753c8db2553449caea190d53679168f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ccfd91-8334-4cfd-bb12-16138ee854b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ccfd91-8334-4cfd-bb12-16138ee854b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d45770f-5557-4b73-ba3e-e8408c01f9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d45770f-5557-4b73-ba3e-e8408c01f9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b7a036-b255-4f63-a7e3-ecfeb7387b24', 'volume_name': 'volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4752f836-0f49-4189-9116-c59ff064745b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4752f836-0f49-4189-9116-c59ff064745b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f496f67-c3b5-4845-8edc-1940802622e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:07 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Volume 18b7a036-b255-4f63-a7e3-ecfeb7387b24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24', 'volume_size': 1} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-880815523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b7a036-b255-4f63-a7e3-ecfeb7387b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d953702ac8c45a3867b9671437f1df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:08Z,use_quota=True,user_id='e753c8db2553449caea190d53679168f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Creating volume 18b7a036-b255-4f63-a7e3-ecfeb7387b24 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:17:07 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:17:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:07 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 1073741824 Jun 25 18:17:07 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:08 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c5d216a7-b824-4098-b8b9-71102d703b95" returned: 0 in 1.238s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c5d216a7-b824-4098-b8b9-71102d703b95 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:08 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c5d216a7-b824-4098-b8b9-71102d703b95 Jun 25 18:17:08 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:09 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 1073741824" returned: 0 in 1.462s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:09 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 Jun 25 18:17:09 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:09 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c5d216a7-b824-4098-b8b9-71102d703b95" returned: 0 in 1.052s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Lock "cinder-quobyte-c5d216a7-b824-4098-b8b9-71102d703b95" released by "delete_volume" :: held 2.374s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:09 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Created reservations ['338cf835-157e-4b1e-8ec2-0cba27a98803', 'eaa41323-943e-4c4a-b41c-7ce8e905a873', '4504be4a-23e5-4154-9bbb-514eed1cdf0d', 'ad2a58c4-86f6-4d86-bd2e-ad50aa1143f4'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:09 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:17:09 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:10 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24" returned: 0 in 1.311s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] <== create_volume: return (2848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:17:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.856s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:10 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.081s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:10 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f496f67-c3b5-4845-8edc-1940802622e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051dd2b0-dd03-4b68-a52b-532ff066bc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Deleted volume successfully. Jun 25 18:17:10 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Volume volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 (18b7a036-b255-4f63-a7e3-ecfeb7387b24): created successfully Jun 25 18:17:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051dd2b0-dd03-4b68-a52b-532ff066bc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Flow 'volume_create_manager' (ea452399-986a-440c-8030-c5d24b63c88c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-3794fa79-68ed-4121-a8b5-0ba792c5aa12 tempest-VolumesSnapshotTestJSON-511404840 None] Created volume successfully. Jun 25 18:17:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e509f457-ec98-4a9b-8022-f1a12520ed9d tempest-VolumeQuotasAdminTestJSON-1355319331 None] Lock "cinder-c5d216a7-b824-4098-b8b9-71102d703b95-delete_volume" released by "delete_volume" :: held 3.852s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] Creating offline snapshot 47ecdd9a-c2b0-431e-8212-d67d10bf6e63 of volume 18b7a036-b255-4f63-a7e3-ecfeb7387b24 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:17:11 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3dbd53-d65c-4f0d-b628-22a33a398d0f]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:11 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 Jun 25 18:17:11 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24" returned: 0 in 1.174s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:12 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:12 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 1G Jun 25 18:17:12 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:13 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 1G" returned: 0 in 1.174s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:13 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 Jun 25 18:17:13 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:14 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63" returned: 0 in 1.083s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:14 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 is being set with open permissions: ugo+rw Jun 25 18:17:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:14 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 Jun 25 18:17:14 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:16 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63" returned: 0 in 1.222s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:16 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.info Jun 25 18:17:16 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:17 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.info" returned: 0 in 0.933s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:17 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.info is being set with open permissions: ugo+rw Jun 25 18:17:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:17 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.info Jun 25 18:17:17 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:17 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.info" returned: 0 in 0.934s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.711s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:18 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-31a42d3a-552c-4eed-ae81-0270f0e89c5b tempest-VolumesSnapshotTestJSON-511404840 None] Create snapshot completed successfully Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Flow 'volume_create_manager' (8a83980d-9b69-4401-89ea-11ead2e23bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbbd9fd-9439-47b7-a7ee-939a92408d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbbd9fd-9439-47b7-a7ee-939a92408d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1787314581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26661644-7f5c-476c-9545-94e7ec0ec90c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d953702ac8c45a3867b9671437f1df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=47ecdd9a-c2b0-431e-8212-d67d10bf6e63,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:20Z,use_quota=True,user_id='e753c8db2553449caea190d53679168f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924fd14e-3f4e-4c14-80b7-99f314baa1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924fd14e-3f4e-4c14-80b7-99f314baa1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c20aa0-2cd7-4085-998c-00212aafc267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c20aa0-2cd7-4085-998c-00212aafc267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '26661644-7f5c-476c-9545-94e7ec0ec90c', 'volume_name': 'volume-26661644-7f5c-476c-9545-94e7ec0ec90c', 'volume_size': 2, 'snapshot_id': '47ecdd9a-c2b0-431e-8212-d67d10bf6e63'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b2d247-0e2d-4951-ac30-a11f19900665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b2d247-0e2d-4951-ac30-a11f19900665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63eb6e0d-ca20-45be-95dc-640fa2ce9a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:19 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Volume 26661644-7f5c-476c-9545-94e7ec0ec90c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-26661644-7f5c-476c-9545-94e7ec0ec90c', 'volume_size': 2, 'snapshot_id': '47ecdd9a-c2b0-431e-8212-d67d10bf6e63'} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-47ecdd9a-c2b0-431e-8212-d67d10bf6e63-26661644-7f5c-476c-9545-94e7ec0ec90c" by "_create_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-47ecdd9a-c2b0-431e-8212-d67d10bf6e63-26661644-7f5c-476c-9545-94e7ec0ec90c" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Creating volume 26661644-7f5c-476c-9545-94e7ec0ec90c from snapshot 47ecdd9a-c2b0-431e-8212-d67d10bf6e63 {{(pid=93651) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-26661644-7f5c-476c-9545-94e7ec0ec90c" by "_copy_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-26661644-7f5c-476c-9545-94e7ec0ec90c" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] snapshot: 47ecdd9a-c2b0-431e-8212-d67d10bf6e63, volume: 26661644-7f5c-476c-9545-94e7ec0ec90c, {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ba8b18-76a7-4845-a509-d266a19f892c]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:20 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 Jun 25 18:17:20 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:21 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63" returned: 0 in 1.324s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:17:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] will copy from snapshot at /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:17:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Creating direct copy from snapshot {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:17:21 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc08ce0-d750-4317-9383-bef08e7c3f85]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:21 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 Jun 25 18:17:21 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:22 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24" returned: 0 in 1.066s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:22 devstack cinder-volume[93651]: DEBUG cinder.utils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Path /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c not found in is_blk_device check {{(pid=93651) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:17:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:22 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c Jun 25 18:17:22 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:29 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c" returned: 0 in 7.406s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:29 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0c0499-6fad-4d6f-8794-348954983db2]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:29 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=65,cinder:UPDATE=73,cinder:INSERT=23,cinder:DELETE=6 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:17:29 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=67,cinder:UPDATE=79,cinder:INSERT=14,cinder:DELETE=8 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:17:30 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 Jun 25 18:17:30 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:31 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24" returned: 0 in 1.480s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:31 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Image conversion details: src /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:17:31 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Converted 1024.00 MB image at 138.24 MB/s Jun 25 18:17:31 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c is being set with open permissions: ugo+rw Jun 25 18:17:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:31 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c Jun 25 18:17:31 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:32 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c" returned: 0 in 0.900s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-26661644-7f5c-476c-9545-94e7ec0ec90c" released by "_copy_volume_from_snapshot" :: held 12.316s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-47ecdd9a-c2b0-431e-8212-d67d10bf6e63-26661644-7f5c-476c-9545-94e7ec0ec90c" released by "_create_volume_from_snapshot" :: held 12.368s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.393s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63eb6e0d-ca20-45be-95dc-640fa2ce9a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26661644-7f5c-476c-9545-94e7ec0ec90c', 'volume_size': 2, 'snapshot_id': '47ecdd9a-c2b0-431e-8212-d67d10bf6e63'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3ac08b-5d6f-45eb-ba58-5cdd69991ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:32 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Volume volume-26661644-7f5c-476c-9545-94e7ec0ec90c (26661644-7f5c-476c-9545-94e7ec0ec90c): created successfully Jun 25 18:17:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3ac08b-5d6f-45eb-ba58-5cdd69991ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Flow 'volume_create_manager' (8a83980d-9b69-4401-89ea-11ead2e23bc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:32 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-8f4a981d-7abf-4b0b-8b16-c26bd5cb9025 tempest-VolumesSnapshotTestJSON-511404840 None] Created volume successfully. Jun 25 18:17:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-26661644-7f5c-476c-9545-94e7ec0ec90c-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-26661644-7f5c-476c-9545-94e7ec0ec90c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-26661644-7f5c-476c-9545-94e7ec0ec90c" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-26661644-7f5c-476c-9545-94e7ec0ec90c" acquired by "delete_volume" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:33 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a9db28-f168-49f3-beaa-99eb4317d290]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:33 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c Jun 25 18:17:34 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:35 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c" returned: 0 in 1.222s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:35 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c Jun 25 18:17:35 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:36 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-26661644-7f5c-476c-9545-94e7ec0ec90c" returned: 0 in 1.018s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-26661644-7f5c-476c-9545-94e7ec0ec90c" released by "delete_volume" :: held 2.309s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:36 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Created reservations ['ea4712ee-e633-426d-8c44-87e4fd5d78e6', '13e8ef79-3a1b-40bd-8348-5ca9a5d3a602', '1b22ce7b-aad7-4114-aadd-7ab713393c78', '65dfd02b-e695-4598-964b-8bf7c7d81324'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:36 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:17:36 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:37 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.841s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:37 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:37 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Deleted volume successfully. Jun 25 18:17:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f9fbb9d3-ad89-42dd-b5e8-64661850bf78 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-26661644-7f5c-476c-9545-94e7ec0ec90c-delete_volume" released by "delete_volume" :: held 3.521s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-47ecdd9a-c2b0-431e-8212-d67d10bf6e63-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-47ecdd9a-c2b0-431e-8212-d67d10bf6e63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-18b7a036-b255-4f63-a7e3-ecfeb7387b24" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-18b7a036-b255-4f63-a7e3-ecfeb7387b24" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-47ecdd9a-c2b0-431e-8212-d67d10bf6e63" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-47ecdd9a-c2b0-431e-8212-d67d10bf6e63" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Deleting offline snapshot 47ecdd9a-c2b0-431e-8212-d67d10bf6e63 of volume 18b7a036-b255-4f63-a7e3-ecfeb7387b24 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:17:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] snapshot_file for this snap is: volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:17:37 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d238efb-5b51-456d-9b59-d1ac5b2f43cd]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:37 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 Jun 25 18:17:37 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:38 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63" returned: 0 in 1.050s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:38 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:17:38 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6fd70e-9c12-4142-ab44-3df6f010a923]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:38 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 Jun 25 18:17:38 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:17:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:39 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:17:39 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:39 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24" returned: 0 in 1.223s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:39 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 Jun 25 18:17:39 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:40 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.383s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:17:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 28 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:17:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:17:41 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63" returned: 0 in 1.479s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:41 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63 Jun 25 18:17:41 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:42 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24.47ecdd9a-c2b0-431e-8212-d67d10bf6e63" returned: 0 in 0.997s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-47ecdd9a-c2b0-431e-8212-d67d10bf6e63" released by "_delete_snapshot" :: held 4.892s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-18b7a036-b255-4f63-a7e3-ecfeb7387b24" released by "delete_snapshot" :: held 4.920s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Created reservations ['e2341ef8-8203-42c7-8a50-1157f7d335a8', '9c878971-94df-47e2-b70c-8a0a828d5fc7', 'fd6c413f-2db8-4ac6-b76f-c66b4b0912a9', '40af1af1-b2ad-4a43-9235-15dd3f36913a'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:42 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Delete snapshot completed successfully. Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a55f3a26-7880-4b6d-b54d-75bb6d477182 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-47ecdd9a-c2b0-431e-8212-d67d10bf6e63-delete_snapshot" released by "delete_snapshot" :: held 5.153s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-18b7a036-b255-4f63-a7e3-ecfeb7387b24-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-18b7a036-b255-4f63-a7e3-ecfeb7387b24-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Flow 'volume_create_manager' (210badb1-1c40-4212-9379-c59bfae2708a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e06b3f-e298-45a5-bb0c-48d52de13a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e06b3f-e298-45a5-bb0c-48d52de13a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-450337528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d3fb56-fb61-44f3-b1b3-603dc67343c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c185e5cff1e4d7aae0a990a38f91dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:43Z,use_quota=True,user_id='a1b294a0718345e986d8fefd8eeebd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750b2d67-0c49-4586-b23d-6c3499c69395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750b2d67-0c49-4586-b23d-6c3499c69395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5f5c21-8c8d-4928-8744-c75b05b7b3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.image.glance [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Creating Keystone auth plugin from conf {{(pid=93651) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-18b7a036-b255-4f63-a7e3-ecfeb7387b24" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-18b7a036-b255-4f63-a7e3-ecfeb7387b24" acquired by "delete_volume" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c32bd8-bba9-4f6c-9621-1760b5e02469]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:43 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 Jun 25 18:17:43 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5f5c21-8c8d-4928-8744-c75b05b7b3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '62d3fb56-fb61-44f3-b1b3-603dc67343c0', 'volume_name': 'volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0', 'volume_size': 1, 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab240da4b4934e58a24c7f836ed62427', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'created_at': datetime.datetime(2026, 6, 25, 15, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 58, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319f4ede-ff0a-401d-8156-237dab222967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319f4ede-ff0a-401d-8156-237dab222967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a3f1e1-f3c4-4485-a0ff-a7852853ad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:43 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Volume 62d3fb56-fb61-44f3-b1b3-603dc67343c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0', 'volume_size': 1, 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab240da4b4934e58a24c7f836ed62427', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'created_at': datetime.datetime(2026, 6, 25, 15, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 58, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 18:17:43 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Trying to clone 62d3fb56-fb61-44f3-b1b3-603dc67343c0 from image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c at location (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]). {{(pid=93651) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:17:43 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_dvijnd2mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:17:43 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Image download 20.69 MB at 20.69 MB/s Jun 25 18:17:44 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed2a986-534e-4f79-9d9b-6218eedc08e0]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_dvijnd2mdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:44 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_dvijnd2mdevstack@QuobyteHD Jun 25 18:17:44 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:44 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24" returned: 0 in 1.355s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:44 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24 Jun 25 18:17:44 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:44 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_dvijnd2mdevstack@QuobyteHD" returned: 0 in 0.911s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:44 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Temporary image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c is fetched for user a1b294a0718345e986d8fefd8eeebd6e. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:17:45 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ce7312-f515-4b7e-9c66-d174acb7b98d]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_dvijnd2mdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:45 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_dvijnd2mdevstack@QuobyteHD Jun 25 18:17:45 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:45 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-18b7a036-b255-4f63-a7e3-ecfeb7387b24" returned: 0 in 1.044s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:45 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-18b7a036-b255-4f63-a7e3-ecfeb7387b24" released by "delete_volume" :: held 2.491s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:45 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Created reservations ['de6e3701-4f66-4a58-9194-520148d53c1e', 'f218699d-556d-4d91-a7ce-ec55a4b09a09', '171d5a11-e4d6-4573-9ee3-9412a4c76a63', '96578ced-bfdc-4e99-9289-e0ae4f8dc6d4'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:17:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:45 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:17:45 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:46 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_dvijnd2mdevstack@QuobyteHD" returned: 0 in 1.603s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-450337528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d3fb56-fb61-44f3-b1b3-603dc67343c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c185e5cff1e4d7aae0a990a38f91dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:43Z,use_quota=True,user_id='a1b294a0718345e986d8fefd8eeebd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:17:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Creating volume 62d3fb56-fb61-44f3-b1b3-603dc67343c0 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:17:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:17:46 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:17:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:46 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 1073741824 Jun 25 18:17:46 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:47 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.281s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:17:47 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Deleted volume successfully. Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-406fe95a-1e3e-4868-b238-33a6b259bc31 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-18b7a036-b255-4f63-a7e3-ecfeb7387b24-delete_volume" released by "delete_volume" :: held 4.352s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Flow 'volume_create_manager' (e39f9c63-54eb-42ee-aa18-82d1572aff3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840c07fa-ce8e-4244-8bb8-6dd3bfabfc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840c07fa-ce8e-4244-8bb8-6dd3bfabfc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2024935633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0da64be-7a2a-4b0c-a434-593be958d9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d953702ac8c45a3867b9671437f1df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:47Z,use_quota=True,user_id='e753c8db2553449caea190d53679168f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b40e00d-bddc-4326-ae23-fad9c4b592af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b40e00d-bddc-4326-ae23-fad9c4b592af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4911d1-74a5-4bec-9a68-f53e4820169a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4911d1-74a5-4bec-9a68-f53e4820169a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0da64be-7a2a-4b0c-a434-593be958d9fc', 'volume_name': 'volume-f0da64be-7a2a-4b0c-a434-593be958d9fc', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8d47bc-0dba-42eb-8a5d-53e4fff911eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8d47bc-0dba-42eb-8a5d-53e4fff911eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb550723-cdb6-4f34-9cf8-e1cefa564a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:47 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Volume f0da64be-7a2a-4b0c-a434-593be958d9fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0da64be-7a2a-4b0c-a434-593be958d9fc', 'volume_size': 1} Jun 25 18:17:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:48 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 1073741824" returned: 0 in 1.311s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:48 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 Jun 25 18:17:48 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:48 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0" returned: 0 in 0.850s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] <== create_volume: return (2241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.247s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.488s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2024935633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0da64be-7a2a-4b0c-a434-593be958d9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d953702ac8c45a3867b9671437f1df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:47Z,use_quota=True,user_id='e753c8db2553449caea190d53679168f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Creating volume f0da64be-7a2a-4b0c-a434-593be958d9fc {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:17:48 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:17:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:49 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc 1073741824 Jun 25 18:17:49 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:49 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Attempting download of 2834cfdd-f1d3-4acf-a5ec-74a95c79167c ((None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}])) to volume 62d3fb56-fb61-44f3-b1b3-603dc67343c0. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:17:49 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40e247f-bbbf-48ab-bacd-83706f7161f4]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_s3kcomtt {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:49 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_s3kcomtt Jun 25 18:17:49 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:50 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_s3kcomtt" returned: 0 in 1.053s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_s3kcomtt {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:50 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc 1073741824" returned: 0 in 1.275s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:50 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_s3kcomtt Jun 25 18:17:50 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:50 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc Jun 25 18:17:50 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:51 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_s3kcomtt" returned: 1 in 1.002s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_s3kcomtt' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:17:51 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e6602a-3003-4b52-90ee-64fd4c86c00f]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_dvijnd2mdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:51 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc" returned: 0 in 0.930s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:51 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] <== create_volume: return (2289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:17:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb550723-cdb6-4f34-9cf8-e1cefa564a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0da64be-7a2a-4b0c-a434-593be958d9fc', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcb91e6-4906-4173-8633-354116ffed2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:51 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Volume volume-f0da64be-7a2a-4b0c-a434-593be958d9fc (f0da64be-7a2a-4b0c-a434-593be958d9fc): created successfully Jun 25 18:17:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcb91e6-4906-4173-8633-354116ffed2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Flow 'volume_create_manager' (e39f9c63-54eb-42ee-aa18-82d1572aff3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:51 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_dvijnd2mdevstack@QuobyteHD Jun 25 18:17:51 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:51 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-77c36c68-8da2-4b74-89ab-8439a0b41f4a tempest-VolumesSnapshotTestJSON-511404840 None] Created volume successfully. Jun 25 18:17:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:51 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] Creating offline snapshot 68c3be43-e390-4226-816b-8892393cce6d of volume f0da64be-7a2a-4b0c-a434-593be958d9fc {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:17:52 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[2126f53e-da27-44c2-b5ec-09f683776107]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:52 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc Jun 25 18:17:52 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:52 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_dvijnd2mdevstack@QuobyteHD" returned: 0 in 1.216s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:52 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] 2834cfdd-f1d3-4acf-a5ec-74a95c79167c was qcow2, converting to raw {{(pid=93651) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:17:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_dvijnd2mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:52 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_dvijnd2mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 Jun 25 18:17:52 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:53 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc" returned: 0 in 1.188s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:53 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d 1G Jun 25 18:17:53 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:54 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d 1G" returned: 0 in 1.274s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0da64be-7a2a-4b0c-a434-593be958d9fc -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:54 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0da64be-7a2a-4b0c-a434-593be958d9fc -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d Jun 25 18:17:54 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:55 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_dvijnd2mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0" returned: 0 in 2.901s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:55 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_dvijnd2mdevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:17:55 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Converted 112.00 MB image at 38.59 MB/s Jun 25 18:17:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:55 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0da64be-7a2a-4b0c-a434-593be958d9fc -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d" returned: 0 in 0.883s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:55 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d is being set with open permissions: ugo+rw Jun 25 18:17:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:55 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 1G Jun 25 18:17:55 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:55 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d Jun 25 18:17:55 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:56 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d" returned: 0 in 0.741s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:56 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.info Jun 25 18:17:56 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:56 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 1G" returned: 0 in 0.858s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:56 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c736091-d57b-476f-99f6-1bd7fe5e7a79]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:17:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:56 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 Jun 25 18:17:56 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:57 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.info" returned: 0 in 0.849s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:57 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.info is being set with open permissions: ugo+rw Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:57 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.info Jun 25 18:17:57 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:57 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0" returned: 0 in 1.073s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:57 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 Jun 25 18:17:57 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Flow 'volume_create_manager' (3df31d52-3ef1-4952-826d-525fd6c980bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f81ea2-2a06-46d2-bc32-584878657ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f81ea2-2a06-46d2-bc32-584878657ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1717268792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=883f5e57-425a-4c4f-84f7-e13a71f33a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4326f3036a46cc8d80c51f75ff77c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:57Z,use_quota=True,user_id='fc7a5545b3004a30bed3529ca3e4d754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a3707c2-d6b9-4bd7-b218-e0cce3ce7b73),volume_type_id=1a3707c2-d6b9-4bd7-b218-e0cce3ce7b73)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa39e847-a87e-4dda-8a1a-c6006feb085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa39e847-a87e-4dda-8a1a-c6006feb085f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50ba186-01a2-4dcd-9176-5b7ecd8c3f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50ba186-01a2-4dcd-9176-5b7ecd8c3f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '883f5e57-425a-4c4f-84f7-e13a71f33a01', 'volume_name': 'volume-883f5e57-425a-4c4f-84f7-e13a71f33a01', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4f9347-41fe-4d82-95ee-3fb00d21b67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4f9347-41fe-4d82-95ee-3fb00d21b67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c1adca-9f38-469a-8cf5-1206e0cc487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:57 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Volume 883f5e57-425a-4c4f-84f7-e13a71f33a01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-883f5e57-425a-4c4f-84f7-e13a71f33a01', 'volume_size': 1} Jun 25 18:17:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Flow 'volume_create_manager' (3b7082b7-091f-4087-b74c-b574003eda9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c26a68c-2d95-4a80-a3e9-166a23f1598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c26a68c-2d95-4a80-a3e9-166a23f1598d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-193976433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11da3b96-decb-48dd-865b-7507ea9cd9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4326f3036a46cc8d80c51f75ff77c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:58Z,use_quota=True,user_id='fc7a5545b3004a30bed3529ca3e4d754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de835c68-2961-4232-aee9-89eb236a8096),volume_type_id=de835c68-2961-4232-aee9-89eb236a8096)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a0d74e-eb17-4f19-b098-98804aaeb286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a0d74e-eb17-4f19-b098-98804aaeb286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22246b55-ed77-43a6-a55c-2dd5d47969f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22246b55-ed77-43a6-a55c-2dd5d47969f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11da3b96-decb-48dd-865b-7507ea9cd9df', 'volume_name': 'volume-11da3b96-decb-48dd-865b-7507ea9cd9df', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32100d1-56a4-484f-ae8e-66c4c0f95ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32100d1-56a4-484f-ae8e-66c4c0f95ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f1057e-8985-4e8c-bb54-0e389c5ce2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:58 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Volume 11da3b96-decb-48dd-865b-7507ea9cd9df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11da3b96-decb-48dd-865b-7507ea9cd9df', 'volume_size': 1} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:58 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0" returned: 1 in 1.264s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Downloaded image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c ((None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}])) to volume 62d3fb56-fb61-44f3-b1b3-603dc67343c0 successfully. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Temporary image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c for user a1b294a0718345e986d8fefd8eeebd6e is deleted. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Marking volume 62d3fb56-fb61-44f3-b1b3-603dc67343c0 as bootable. {{(pid=93651) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:17:58 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.info" returned: 0 in 1.618s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.710s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1717268792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=883f5e57-425a-4c4f-84f7-e13a71f33a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4326f3036a46cc8d80c51f75ff77c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:57Z,use_quota=True,user_id='fc7a5545b3004a30bed3529ca3e4d754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a3707c2-d6b9-4bd7-b218-e0cce3ce7b73),volume_type_id=1a3707c2-d6b9-4bd7-b218-e0cce3ce7b73)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Creating volume 883f5e57-425a-4c4f-84f7-e13a71f33a01 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:17:58 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Copying metadata from image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c to 62d3fb56-fb61-44f3-b1b3-603dc67343c0. {{(pid=93651) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Creating volume glance metadata for volume 62d3fb56-fb61-44f3-b1b3-603dc67343c0 backed by image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93651) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:17:58 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01 1073741824 Jun 25 18:17:58 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:17:58 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-01bb1b2c-4b72-45a1-b7d4-d507471bba75 tempest-VolumesSnapshotTestJSON-511404840 None] Create snapshot completed successfully Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a3f1e1-f3c4-4485-a0ff-a7852853ad09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0', 'volume_size': 1, 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab240da4b4934e58a24c7f836ed62427', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'created_at': datetime.datetime(2026, 6, 25, 15, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 58, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d66cfb4-7426-48f1-ad15-aa293f29dfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:58 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Volume volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 (62d3fb56-fb61-44f3-b1b3-603dc67343c0): created successfully Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d66cfb4-7426-48f1-ad15-aa293f29dfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Flow 'volume_create_manager' (210badb1-1c40-4212-9379-c59bfae2708a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:58 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6fdc0f84-981e-4de6-8178-3a7b43a068f5 tempest-VolumesImageMetadata-795410870 None] Created volume successfully. Jun 25 18:17:59 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:17:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Flow 'volume_create_manager' (c37ebde0-9031-4eb9-965e-d8b7f7997c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:17:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27fc3864-b826-42e4-a054-3869c4c042aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27fc3864-b826-42e4-a054-3869c4c042aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2017555543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef859d7-53cb-402d-9b63-3fbf1f46af94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4326f3036a46cc8d80c51f75ff77c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:59Z,use_quota=True,user_id='fc7a5545b3004a30bed3529ca3e4d754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(973ddff7-2265-4eab-b102-b6a007c72681),volume_type_id=973ddff7-2265-4eab-b102-b6a007c72681)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6088cbc7-7728-4604-9f7e-97fa24938348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6088cbc7-7728-4604-9f7e-97fa24938348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc31928c-b5ea-4fd9-b2f7-4f54d7680e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:59 devstack cinder-volume[93651]: DEBUG cinder.image.glance [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Creating Keystone auth plugin from conf {{(pid=93651) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:17:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc31928c-b5ea-4fd9-b2f7-4f54d7680e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cef859d7-53cb-402d-9b63-3fbf1f46af94', 'volume_name': 'volume-cef859d7-53cb-402d-9b63-3fbf1f46af94', 'volume_size': 1, 'image_id': 'deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1543432237', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4326f3036a46cc8d80c51f75ff77c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20', 'created_at': datetime.datetime(2026, 6, 25, 16, 17, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 17, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20/file', 'properties': {}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9e47d3-17f0-4c68-9345-e2946d8b36d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9e47d3-17f0-4c68-9345-e2946d8b36d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:17:59 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847f1da4-a7e9-4d7d-bedf-b64d1afae061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:17:59 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Volume cef859d7-53cb-402d-9b63-3fbf1f46af94: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cef859d7-53cb-402d-9b63-3fbf1f46af94', 'volume_size': 1, 'image_id': 'deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1543432237', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4326f3036a46cc8d80c51f75ff77c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20', 'created_at': datetime.datetime(2026, 6, 25, 16, 17, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 17, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20/file', 'properties': {}}, 'image_service': } Jun 25 18:17:59 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Trying to clone cef859d7-53cb-402d-9b63-3fbf1f46af94 from image deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20 at location (None, [{'url': 'file:///opt/stack/data/glance/images/deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20', 'metadata': {}}]). {{(pid=93651) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:18:00 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01 1073741824" returned: 0 in 1.576s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Acquiring lock "cinder-62d3fb56-fb61-44f3-b1b3-603dc67343c0-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:00 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01 Jun 25 18:18:00 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Lock "cinder-62d3fb56-fb61-44f3-b1b3-603dc67343c0-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Acquiring lock "cinder-quobyte-62d3fb56-fb61-44f3-b1b3-603dc67343c0" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Lock "cinder-quobyte-62d3fb56-fb61-44f3-b1b3-603dc67343c0" acquired by "delete_volume" :: waited 0.032s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:00 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5be631a-2b02-45d6-9566-52a7eeb64140]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:00 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 Jun 25 18:18:00 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:00 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Flow 'volume_create_manager' (dcf13141-22e7-42c8-b9e7-0f83550c29b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637aa237-32eb-40ac-9247-e3ca8f948168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637aa237-32eb-40ac-9247-e3ca8f948168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1368574882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8f955a-aa0b-4f00-9f12-6194f3684e79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d953702ac8c45a3867b9671437f1df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=68c3be43-e390-4226-816b-8892393cce6d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:01Z,use_quota=True,user_id='e753c8db2553449caea190d53679168f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03b3f2d-7357-4422-885e-3a86b377f6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03b3f2d-7357-4422-885e-3a86b377f6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75209aa-83a7-4517-a3bd-0c6d72660eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75209aa-83a7-4517-a3bd-0c6d72660eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7f8f955a-aa0b-4f00-9f12-6194f3684e79', 'volume_name': 'volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79', 'volume_size': 1, 'snapshot_id': '68c3be43-e390-4226-816b-8892393cce6d'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb78ac5-a6d2-4ea4-b99c-e164dbaba1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb78ac5-a6d2-4ea4-b99c-e164dbaba1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639f1888-f148-4638-a5eb-f43c61bb8ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:01 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Volume 7f8f955a-aa0b-4f00-9f12-6194f3684e79: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79', 'volume_size': 1, 'snapshot_id': '68c3be43-e390-4226-816b-8892393cce6d'} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:01 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01" returned: 0 in 1.165s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] <== create_volume: return (2888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.891s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.092s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-193976433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11da3b96-decb-48dd-865b-7507ea9cd9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4326f3036a46cc8d80c51f75ff77c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:58Z,use_quota=True,user_id='fc7a5545b3004a30bed3529ca3e4d754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de835c68-2961-4232-aee9-89eb236a8096),volume_type_id=de835c68-2961-4232-aee9-89eb236a8096)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Creating volume 11da3b96-decb-48dd-865b-7507ea9cd9df {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:18:01 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:01 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df 1073741824 Jun 25 18:18:01 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c1adca-9f38-469a-8cf5-1206e0cc487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-883f5e57-425a-4c4f-84f7-e13a71f33a01', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cba19e9-ee5c-4b7a-8d0d-124007f4c4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:01 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Volume volume-883f5e57-425a-4c4f-84f7-e13a71f33a01 (883f5e57-425a-4c4f-84f7-e13a71f33a01): created successfully Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cba19e9-ee5c-4b7a-8d0d-124007f4c4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Flow 'volume_create_manager' (3df31d52-3ef1-4952-826d-525fd6c980bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:01 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-69fae202-d00d-4e5f-a663-c55a7edf3624 tempest-TestInstancesWithCinderVolumes-1135673885 None] Created volume successfully. Jun 25 18:18:01 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0" returned: 0 in 1.134s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:02 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 Jun 25 18:18:02 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:02 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df 1073741824" returned: 0 in 1.207s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:02 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:02 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df Jun 25 18:18:02 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0" returned: 1 in 1.024s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:18:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:02 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0 Jun 25 18:18:02 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:03 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-62d3fb56-fb61-44f3-b1b3-603dc67343c0" returned: 0 in 0.791s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Lock "cinder-quobyte-62d3fb56-fb61-44f3-b1b3-603dc67343c0" released by "delete_volume" :: held 3.079s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Created reservations ['24deecbe-c964-40fc-ac82-1bf753c423f3', '669b4c9f-8fff-478f-b7bd-1d98ca26bd0d', '872d8f6c-8233-48dc-9ff4-e534c8b5d53e', '827ca5fb-51cc-4f87-a5ed-a101e8d19290'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:18:03 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df" returned: 0 in 0.940s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] <== create_volume: return (2224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.228s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.681s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-68c3be43-e390-4226-816b-8892393cce6d-7f8f955a-aa0b-4f00-9f12-6194f3684e79" by "_create_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f1057e-8985-4e8c-bb54-0e389c5ce2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11da3b96-decb-48dd-865b-7507ea9cd9df', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b6425f-831c-48a1-a2aa-25ac1b6d92d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-68c3be43-e390-4226-816b-8892393cce6d-7f8f955a-aa0b-4f00-9f12-6194f3684e79" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Creating volume 7f8f955a-aa0b-4f00-9f12-6194f3684e79 from snapshot 68c3be43-e390-4226-816b-8892393cce6d {{(pid=93651) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-7f8f955a-aa0b-4f00-9f12-6194f3684e79" by "_copy_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-7f8f955a-aa0b-4f00-9f12-6194f3684e79" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] snapshot: 68c3be43-e390-4226-816b-8892393cce6d, volume: 7f8f955a-aa0b-4f00-9f12-6194f3684e79, {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:03 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Volume volume-11da3b96-decb-48dd-865b-7507ea9cd9df (11da3b96-decb-48dd-865b-7507ea9cd9df): created successfully Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b6425f-831c-48a1-a2aa-25ac1b6d92d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Flow 'volume_create_manager' (3b7082b7-091f-4087-b74c-b574003eda9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b1c9c0-336b-4c18-9b91-e0afbb020337]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:03 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-3d2f1238-8fa0-4165-b9bf-f92da658bb91 tempest-TestInstancesWithCinderVolumes-1135673885 None] Created volume successfully. Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:04 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:18:04 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:04 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d Jun 25 18:18:04 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:04 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.739s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:18:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Deleted volume successfully. Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2ecd79ff-9867-4440-ad11-2b18be06f416 tempest-VolumesImageMetadata-795410870 None] Lock "cinder-62d3fb56-fb61-44f3-b1b3-603dc67343c0-delete_volume" released by "delete_volume" :: held 4.293s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:04 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d" returned: 0 in 0.947s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0da64be-7a2a-4b0c-a434-593be958d9fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] will copy from snapshot at /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Creating direct copy from snapshot {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa59829f-b276-486f-90ea-e9d9bb5b7a78]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:05 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_2o9n_95tdevstack@QuobyteHD, size 20.69 MB, duration 5.06 sec {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:18:05 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Image download 20.69 MB at 4.08 MB/s Jun 25 18:18:05 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc Jun 25 18:18:05 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:05 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3cd984-d271-4dc0-85b0-f2856315415a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_2o9n_95tdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:05 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_2o9n_95tdevstack@QuobyteHD Jun 25 18:18:05 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:05 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc" returned: 0 in 0.951s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:05 devstack cinder-volume[93651]: DEBUG cinder.utils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Path /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79 not found in is_blk_device check {{(pid=93651) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:18:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:05 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79 Jun 25 18:18:05 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:06 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_2o9n_95tdevstack@QuobyteHD" returned: 0 in 1.004s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:06 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Temporary image deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20 is fetched for user fc7a5545b3004a30bed3529ca3e4d754. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:18:06 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ff878e-d03c-4b17-8bc4-b4ffdafacefe]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_2o9n_95tdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:06 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_2o9n_95tdevstack@QuobyteHD Jun 25 18:18:06 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:07 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_2o9n_95tdevstack@QuobyteHD" returned: 0 in 1.081s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79" returned: 0 in 8.245s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:14 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4260e9f7-a745-4cd0-b20b-24b72ead7415]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:14 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc Jun 25 18:18:14 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:15 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc" returned: 0 in 1.206s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:15 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Image conversion details: src /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc, size 1024.00 MB, duration 8.25 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:18:15 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Converted 1024.00 MB image at 124.19 MB/s Jun 25 18:18:15 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79 is being set with open permissions: ugo+rw Jun 25 18:18:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:15 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79 Jun 25 18:18:15 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:16 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79" returned: 0 in 0.789s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-7f8f955a-aa0b-4f00-9f12-6194f3684e79" released by "_copy_volume_from_snapshot" :: held 12.278s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-68c3be43-e390-4226-816b-8892393cce6d-7f8f955a-aa0b-4f00-9f12-6194f3684e79" released by "_create_volume_from_snapshot" :: held 12.320s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.356s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.837s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2017555543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef859d7-53cb-402d-9b63-3fbf1f46af94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4326f3036a46cc8d80c51f75ff77c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:17:59Z,use_quota=True,user_id='fc7a5545b3004a30bed3529ca3e4d754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(973ddff7-2265-4eab-b102-b6a007c72681),volume_type_id=973ddff7-2265-4eab-b102-b6a007c72681)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Creating volume cef859d7-53cb-402d-9b63-3fbf1f46af94 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:18:16 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:16 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 1073741824 Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=40,cinder:UPDATE=44,cinder:INSERT=20,cinder:DELETE=3 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:18:16 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639f1888-f148-4638-a5eb-f43c61bb8ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79', 'volume_size': 1, 'snapshot_id': '68c3be43-e390-4226-816b-8892393cce6d'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3352f67-1b60-41f5-bb61-fcd6ebff86ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:16 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Volume volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79 (7f8f955a-aa0b-4f00-9f12-6194f3684e79): created successfully Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3352f67-1b60-41f5-bb61-fcd6ebff86ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:16 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Flow 'volume_create_manager' (dcf13141-22e7-42c8-b9e7-0f83550c29b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:16 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-b9218244-d76a-422c-b83c-7b1af4298a0b tempest-VolumesSnapshotTestJSON-511404840 None] Created volume successfully. Jun 25 18:18:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-7f8f955a-aa0b-4f00-9f12-6194f3684e79-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-7f8f955a-aa0b-4f00-9f12-6194f3684e79-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-7f8f955a-aa0b-4f00-9f12-6194f3684e79" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-7f8f955a-aa0b-4f00-9f12-6194f3684e79" acquired by "delete_volume" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:17 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[35851651-9790-4fd3-88c5-bb5c52ec8fb2]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:17 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 1073741824" returned: 0 in 1.307s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:17 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79 Jun 25 18:18:17 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:17 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 Jun 25 18:18:17 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:18 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79" returned: 0 in 0.914s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:18 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94" returned: 0 in 0.710s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:18 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] <== create_volume: return (2191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:18:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.195s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:18 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79 Jun 25 18:18:18 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:19 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7f8f955a-aa0b-4f00-9f12-6194f3684e79" returned: 0 in 0.739s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-7f8f955a-aa0b-4f00-9f12-6194f3684e79" released by "delete_volume" :: held 1.692s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:22 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Created reservations ['359eaf85-2f05-4f4d-85b9-6b0e5bcf5e20', '534bf8e0-b28d-4a67-b279-37bfe1a1e763', '98089ca0-e294-45dc-a0d2-78bd7f5bf62f', 'ba77ccb2-e6f9-4070-8ee0-221d3eda4f56'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:18:22 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Attempting download of deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20 ((None, [{'url': 'file:///opt/stack/data/glance/images/deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20', 'metadata': {}}])) to volume cef859d7-53cb-402d-9b63-3fbf1f46af94. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:18:22 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2310856-a305-4bc2-921c-f8e9994b812e]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_x6v3uz9w {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:22 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:18:22 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:22 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_x6v3uz9w Jun 25 18:18:22 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:22 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-68c3be43-e390-4226-816b-8892393cce6d-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:22 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-68c3be43-e390-4226-816b-8892393cce6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:22 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-f0da64be-7a2a-4b0c-a434-593be958d9fc" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:23 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-f0da64be-7a2a-4b0c-a434-593be958d9fc" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:23 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-68c3be43-e390-4226-816b-8892393cce6d" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:23 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-68c3be43-e390-4226-816b-8892393cce6d" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Deleting offline snapshot 68c3be43-e390-4226-816b-8892393cce6d of volume f0da64be-7a2a-4b0c-a434-593be958d9fc {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:18:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] snapshot_file for this snap is: volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:18:23 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3ed3b8-8587-43cf-a33c-a1fedec3ee02]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:23 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d Jun 25 18:18:23 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:23 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.104s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:23 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:18:23 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Deleted volume successfully. Jun 25 18:18:23 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_x6v3uz9w" returned: 0 in 1.237s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_x6v3uz9w {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:23 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f27536b-dbe8-4bc2-9b96-986a5d15714f tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-7f8f955a-aa0b-4f00-9f12-6194f3684e79-delete_volume" released by "delete_volume" :: held 6.147s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:23 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_x6v3uz9w Jun 25 18:18:23 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:24 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d" returned: 0 in 1.148s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0da64be-7a2a-4b0c-a434-593be958d9fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[0114703f-9d58-4288-b3e2-16013e94aa69]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:24 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc Jun 25 18:18:24 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:24 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_x6v3uz9w" returned: 1 in 1.068s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_x6v3uz9w' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b0bda6-13ac-4620-bd6e-e0506e72f0cb]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_2o9n_95tdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Flow 'volume_create_manager' (34161e60-06f5-4a5e-ab0b-a21c4b732965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7000737c-ad07-4ab3-a857-56fed1d52562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7000737c-ad07-4ab3-a857-56fed1d52562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-624391718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b77fe0-097a-4dc0-b5c8-8492d921d3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7bd1e946449399925355540fb66ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:24Z,use_quota=True,user_id='7cfaa9d5cb2a47518f0eae648bcdf3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef494d43-5187-4698-8c24-27d2fd675c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef494d43-5187-4698-8c24-27d2fd675c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880bb440-ed8f-4787-9765-0f87ab726938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880bb440-ed8f-4787-9765-0f87ab726938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b77fe0-097a-4dc0-b5c8-8492d921d3c1', 'volume_name': 'volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c125c0-c021-41c7-bed8-cb74c9d94e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c125c0-c021-41c7-bed8-cb74c9d94e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e940720e-24a1-43dd-ac98-0d8fa52e0575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:24 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Volume 67b77fe0-097a-4dc0-b5c8-8492d921d3c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1', 'volume_size': 1} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-624391718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b77fe0-097a-4dc0-b5c8-8492d921d3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7bd1e946449399925355540fb66ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:24Z,use_quota=True,user_id='7cfaa9d5cb2a47518f0eae648bcdf3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Creating volume 67b77fe0-097a-4dc0-b5c8-8492d921d3c1 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:18:24 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:18:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:24 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_2o9n_95tdevstack@QuobyteHD Jun 25 18:18:24 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:24 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1 1073741824 Jun 25 18:18:24 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:25 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc" returned: 0 in 0.899s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:25 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d Jun 25 18:18:25 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:25 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_2o9n_95tdevstack@QuobyteHD" returned: 0 in 0.834s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:25 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20 was qcow2, converting to raw {{(pid=93651) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:18:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_2o9n_95tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:25 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_2o9n_95tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 Jun 25 18:18:25 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:25 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1 1073741824" returned: 0 in 0.947s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:25 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1 Jun 25 18:18:25 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:26 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d" returned: 0 in 0.857s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:26 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d Jun 25 18:18:26 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:26 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1" returned: 0 in 0.737s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:18:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e940720e-24a1-43dd-ac98-0d8fa52e0575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3786f2-b342-4627-b858-9dd7bff3059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:26 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Volume volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1 (67b77fe0-097a-4dc0-b5c8-8492d921d3c1): created successfully Jun 25 18:18:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3786f2-b342-4627-b858-9dd7bff3059d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Flow 'volume_create_manager' (34161e60-06f5-4a5e-ab0b-a21c4b732965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:26 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-91133371-ec00-46d7-b440-d230cecef28f tempest-VolumesTransfersTest-119359880 None] Created volume successfully. Jun 25 18:18:26 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc.68c3be43-e390-4226-816b-8892393cce6d" returned: 0 in 0.764s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-68c3be43-e390-4226-816b-8892393cce6d" released by "_delete_snapshot" :: held 3.864s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-f0da64be-7a2a-4b0c-a434-593be958d9fc" released by "delete_snapshot" :: held 3.922s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:27 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Created reservations ['6b29a1f2-2b52-4620-9e0b-fcf6937be831', 'c141dd31-a16f-4c73-a753-fe5382edc45b', '06bdcc9d-d64f-4cc3-a56b-7d5fdd0e43cf', '3f980643-4194-42b0-b228-fbb6754830c5'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:18:27 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Delete snapshot completed successfully. Jun 25 18:18:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0c530e42-b355-4697-94a9-95e41075ee76 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-68c3be43-e390-4226-816b-8892393cce6d-delete_snapshot" released by "delete_snapshot" :: held 4.164s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-f0da64be-7a2a-4b0c-a434-593be958d9fc-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-f0da64be-7a2a-4b0c-a434-593be958d9fc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:27 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2deb4d7f-2f06-49cb-8a5b-ed095a3141bc tempest-VolumesTransfersTest-491470790 None] Transfer volume completed successfully. Jun 25 18:18:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-f0da64be-7a2a-4b0c-a434-593be958d9fc" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-f0da64be-7a2a-4b0c-a434-593be958d9fc" acquired by "delete_volume" :: waited 0.018s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:27 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[486f7f9e-a568-49fa-8a41-ccbb4d88314b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:27 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc Jun 25 18:18:27 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:27 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_2o9n_95tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94" returned: 0 in 2.331s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:27 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20_2o9n_95tdevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:18:27 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Converted 112.00 MB image at 48.01 MB/s Jun 25 18:18:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:27 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 1G Jun 25 18:18:27 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:28 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc" returned: 0 in 0.900s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:28 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc Jun 25 18:18:28 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Acquiring lock "cinder-67b77fe0-097a-4dc0-b5c8-8492d921d3c1-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Lock "cinder-67b77fe0-097a-4dc0-b5c8-8492d921d3c1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:28 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 1G" returned: 0 in 0.894s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Acquiring lock "cinder-quobyte-67b77fe0-097a-4dc0-b5c8-8492d921d3c1" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Lock "cinder-quobyte-67b77fe0-097a-4dc0-b5c8-8492d921d3c1" acquired by "delete_volume" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:28 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c8e32b-4751-433b-96a5-00a2c9f622df]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:28 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[901e5c72-c528-4d69-85d5-c00cfff67eb3]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:28 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 Jun 25 18:18:28 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:28 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1 Jun 25 18:18:28 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:29 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f0da64be-7a2a-4b0c-a434-593be958d9fc" returned: 0 in 0.822s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-f0da64be-7a2a-4b0c-a434-593be958d9fc" released by "delete_volume" :: held 1.804s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Created reservations ['310e6120-464c-472e-b724-f215f757ccf6', '07b7dc0b-8d66-44dd-8747-cb1ba612513d', '98e79545-862e-4704-9627-97d470cb710f', 'b3d382f2-d750-4441-ba13-9616247d1081'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:29 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:18:29 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:29 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1" returned: 0 in 0.892s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:29 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1 Jun 25 18:18:29 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:29 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94" returned: 0 in 0.988s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:29 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 Jun 25 18:18:29 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-22e7e860-d255-4276-b689-306f9e519ccd-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-22e7e860-d255-4276-b689-306f9e519ccd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "cinder-quobyte-22e7e860-d255-4276-b689-306f9e519ccd" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-22e7e860-d255-4276-b689-306f9e519ccd" acquired by "delete_volume" :: waited 0.050s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c73805c-de6f-4c4c-87a9-d78ac00b01bb]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:30 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd Jun 25 18:18:30 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-67b77fe0-097a-4dc0-b5c8-8492d921d3c1" returned: 0 in 0.847s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:30 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Lock "cinder-quobyte-67b77fe0-097a-4dc0-b5c8-8492d921d3c1" released by "delete_volume" :: held 1.823s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=77,cinder:DELETE=7,cinder:SELECT=73,cinder:INSERT=23 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Created reservations ['50fbdb9f-8ab1-406c-a299-5b0ed257ba3b', '6465994e-875c-4e0c-b31c-101fb333be78', '9777e464-8892-4258-bd8b-f937737b4dbf', '5a429f35-7443-49dc-8a8c-cf1ec298fb87'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:18:30 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.072s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:18:30 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Deleted volume successfully. Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1973c3e7-6cbf-45a9-ae65-53394d0aa4c2 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-f0da64be-7a2a-4b0c-a434-593be958d9fc-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:30 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:18:30 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:30 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94" returned: 1 in 1.199s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Downloaded image deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20 ((None, [{'url': 'file:///opt/stack/data/glance/images/deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20', 'metadata': {}}])) to volume cef859d7-53cb-402d-9b63-3fbf1f46af94 successfully. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Temporary image deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20 for user fc7a5545b3004a30bed3529ca3e4d754 is deleted. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Marking volume cef859d7-53cb-402d-9b63-3fbf1f46af94 as bootable. {{(pid=93651) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Copying metadata from image deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20 to cef859d7-53cb-402d-9b63-3fbf1f46af94. {{(pid=93651) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:18:30 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Creating volume glance metadata for volume cef859d7-53cb-402d-9b63-3fbf1f46af94 backed by image deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20 with: {'image_id': 'deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20', 'image_name': 'tempest-scenario-img--1543432237', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93651) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847f1da4-a7e9-4d7d-bedf-b64d1afae061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef859d7-53cb-402d-9b63-3fbf1f46af94', 'volume_size': 1, 'image_id': 'deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1543432237', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4326f3036a46cc8d80c51f75ff77c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20', 'created_at': datetime.datetime(2026, 6, 25, 16, 17, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 17, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/deffb33c-fe43-4dc0-bb4b-8c89e7ffbb20/file', 'properties': {}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57ced5c-1678-4fd2-b73e-83aa2bf189e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:31 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Volume volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 (cef859d7-53cb-402d-9b63-3fbf1f46af94): created successfully Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57ced5c-1678-4fd2-b73e-83aa2bf189e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Flow 'volume_create_manager' (c37ebde0-9031-4eb9-965e-d8b7f7997c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:31 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-c2d369e9-80ff-4297-922d-cc29a6289b5d tempest-TestInstancesWithCinderVolumes-1135673885 None] Created volume successfully. Jun 25 18:18:31 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd" returned: 0 in 1.235s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:31 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd Jun 25 18:18:31 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Flow 'volume_create_manager' (2cf4bb50-eef7-4ea5-943c-3700a8a1ee63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a18312-9688-4252-bc09-d045e0b7af5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a18312-9688-4252-bc09-d045e0b7af5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-844315433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66588b94-1b35-47af-8074-2b146f9d601e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7bd1e946449399925355540fb66ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:32Z,use_quota=True,user_id='7cfaa9d5cb2a47518f0eae648bcdf3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32455ff-1d9e-49d4-8338-7d4bafad2125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32455ff-1d9e-49d4-8338-7d4bafad2125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8719bc99-0c9f-4d3f-8ef5-3f7c158368dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8719bc99-0c9f-4d3f-8ef5-3f7c158368dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66588b94-1b35-47af-8074-2b146f9d601e', 'volume_name': 'volume-66588b94-1b35-47af-8074-2b146f9d601e', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecf672a-6244-428a-b885-921f5c2305b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecf672a-6244-428a-b885-921f5c2305b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760c9015-01bd-448a-93c5-92bd7397cbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:31 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Volume 66588b94-1b35-47af-8074-2b146f9d601e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66588b94-1b35-47af-8074-2b146f9d601e', 'volume_size': 1} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-844315433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66588b94-1b35-47af-8074-2b146f9d601e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7bd1e946449399925355540fb66ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:32Z,use_quota=True,user_id='7cfaa9d5cb2a47518f0eae648bcdf3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Creating volume 66588b94-1b35-47af-8074-2b146f9d601e {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:18:31 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-66588b94-1b35-47af-8074-2b146f9d601e 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:31 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.018s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:18:31 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Deleted volume successfully. Jun 25 18:18:31 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-66588b94-1b35-47af-8074-2b146f9d601e 1073741824 Jun 25 18:18:31 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-da48f6d2-e000-439a-bb5d-8b9d86c09103 tempest-VolumesTransfersTest-599170909 None] Lock "cinder-67b77fe0-097a-4dc0-b5c8-8492d921d3c1-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:32 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-22e7e860-d255-4276-b689-306f9e519ccd" returned: 0 in 0.893s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-quobyte-22e7e860-d255-4276-b689-306f9e519ccd" released by "delete_volume" :: held 2.242s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:32 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Created reservations ['dfb58885-f7a2-41c9-bf0f-901d70e810d3', '8084a5b9-53fe-41bd-9628-6516711cca59', 'bd73133f-67f8-4b08-afef-89f1b7bf63f0', 'c8ad34a1-b593-4deb-a003-f0269ec0aabd'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:18:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:32 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:18:32 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:32 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-66588b94-1b35-47af-8074-2b146f9d601e 1073741824" returned: 0 in 1.008s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-66588b94-1b35-47af-8074-2b146f9d601e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:32 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-66588b94-1b35-47af-8074-2b146f9d601e Jun 25 18:18:32 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:33 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.726s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:33 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:18:33 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Deleted volume successfully. Jun 25 18:18:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5bf5ee0d-2319-4596-966f-1e509c4eddb9 tempest-VolumesSnapshotTestJSON-511404840 None] Lock "cinder-22e7e860-d255-4276-b689-306f9e519ccd-delete_volume" released by "delete_volume" :: held 3.418s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:33 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-66588b94-1b35-47af-8074-2b146f9d601e" returned: 0 in 0.712s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:33 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:18:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760c9015-01bd-448a-93c5-92bd7397cbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66588b94-1b35-47af-8074-2b146f9d601e', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec5e870-260f-44b4-a91b-8db56b26d6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:33 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Volume volume-66588b94-1b35-47af-8074-2b146f9d601e (66588b94-1b35-47af-8074-2b146f9d601e): created successfully Jun 25 18:18:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec5e870-260f-44b4-a91b-8db56b26d6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Flow 'volume_create_manager' (2cf4bb50-eef7-4ea5-943c-3700a8a1ee63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:33 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6dd754b6-c4fe-490e-a5d3-6eda79c74491 tempest-VolumesTransfersTest-119359880 None] Created volume successfully. Jun 25 18:18:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Acquiring lock "cinder-66588b94-1b35-47af-8074-2b146f9d601e-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Lock "cinder-66588b94-1b35-47af-8074-2b146f9d601e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Acquiring lock "cinder-quobyte-66588b94-1b35-47af-8074-2b146f9d601e" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Lock "cinder-quobyte-66588b94-1b35-47af-8074-2b146f9d601e" acquired by "delete_volume" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:34 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1bdd08-9228-4ff4-8c4e-d07e4e8c0aea]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-66588b94-1b35-47af-8074-2b146f9d601e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:34 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-66588b94-1b35-47af-8074-2b146f9d601e Jun 25 18:18:34 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:35 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-66588b94-1b35-47af-8074-2b146f9d601e" returned: 0 in 0.861s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-66588b94-1b35-47af-8074-2b146f9d601e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:35 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-66588b94-1b35-47af-8074-2b146f9d601e Jun 25 18:18:35 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:35 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-66588b94-1b35-47af-8074-2b146f9d601e" returned: 0 in 0.822s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Lock "cinder-quobyte-66588b94-1b35-47af-8074-2b146f9d601e" released by "delete_volume" :: held 1.745s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Created reservations ['7d7170ce-3a5e-4fef-8095-394735f0356b', 'b055d12d-8ed4-4570-85ac-6ad9cdffe930', 'f84c03dc-1783-4c7e-b102-589629334eda', '2e8b0fa4-84b7-4c79-bb15-787fff2c1f15'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:36 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:18:36 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Flow 'volume_create_manager' (4e3c0fea-1360-4cc5-96c2-f06a62a1d756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9940e2a2-fdb1-4592-a087-49c690d70d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9940e2a2-fdb1-4592-a087-49c690d70d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-809289460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560f1982-5d36-4697-957a-0b04b34d7af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='accb2890c1d444a8af028a7fced074d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:37Z,use_quota=True,user_id='841494c1c8a7476d912acaa7c74ff164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2b1212-3615-4ceb-b919-77a3386ea45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2b1212-3615-4ceb-b919-77a3386ea45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617aa732-7d05-4d59-9397-4e61c644b53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617aa732-7d05-4d59-9397-4e61c644b53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '560f1982-5d36-4697-957a-0b04b34d7af3', 'volume_name': 'volume-560f1982-5d36-4697-957a-0b04b34d7af3', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f7d407-8e01-4a45-a92f-615aefa90111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f7d407-8e01-4a45-a92f-615aefa90111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f3ce33-67c3-493f-a667-0c0b0c0263f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:36 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Volume 560f1982-5d36-4697-957a-0b04b34d7af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-560f1982-5d36-4697-957a-0b04b34d7af3', 'volume_size': 1} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-809289460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560f1982-5d36-4697-957a-0b04b34d7af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='accb2890c1d444a8af028a7fced074d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:37Z,use_quota=True,user_id='841494c1c8a7476d912acaa7c74ff164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Creating volume 560f1982-5d36-4697-957a-0b04b34d7af3 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:18:36 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:18:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:36 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3 1073741824 Jun 25 18:18:36 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:37 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.975s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:37 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:18:37 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Deleted volume successfully. Jun 25 18:18:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-315c46b0-9fb7-47b6-a045-65f6b349e412 tempest-VolumesTransfersTest-599170909 None] Lock "cinder-66588b94-1b35-47af-8074-2b146f9d601e-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:18:38 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3 1073741824" returned: 0 in 1.185s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:38 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3 Jun 25 18:18:38 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:38 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3" returned: 0 in 0.847s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:38 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:18:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:38 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f3ce33-67c3-493f-a667-0c0b0c0263f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-560f1982-5d36-4697-957a-0b04b34d7af3', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:39 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572ecf2c-b6e2-4d1b-8f84-cc73d5b6f564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:39 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Volume volume-560f1982-5d36-4697-957a-0b04b34d7af3 (560f1982-5d36-4697-957a-0b04b34d7af3): created successfully Jun 25 18:18:39 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572ecf2c-b6e2-4d1b-8f84-cc73d5b6f564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:39 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Flow 'volume_create_manager' (4e3c0fea-1360-4cc5-96c2-f06a62a1d756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:39 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-26a36bc8-d781-4160-b271-2a08677bc16c tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Created volume successfully. Jun 25 18:18:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:18:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:39 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:18:39 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-8e32e491-b90e-4c59-8a86-d84a6b5dc64f req-aaf46940-6634-4c89-8343-fbb2880db608 tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-8e32e491-b90e-4c59-8a86-d84a6b5dc64f req-aaf46940-6634-4c89-8343-fbb2880db608 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:40 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c99ade-ebcd-4751-a89c-bac89e94aa9c]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-8e32e491-b90e-4c59-8a86-d84a6b5dc64f req-aaf46940-6634-4c89-8343-fbb2880db608 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:40 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:40 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 Jun 25 18:18:40 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.292s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:18:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:18:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 28 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:18:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:18:41 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-8e32e491-b90e-4c59-8a86-d84a6b5dc64f req-aaf46940-6634-4c89-8343-fbb2880db608 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94" returned: 0 in 1.103s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-8e32e491-b90e-4c59-8a86-d84a6b5dc64f req-aaf46940-6634-4c89-8343-fbb2880db608 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:41 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 Jun 25 18:18:41 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-8e32e491-b90e-4c59-8a86-d84a6b5dc64f req-aaf46940-6634-4c89-8343-fbb2880db608 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94" returned: 1 in 0.902s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-8e32e491-b90e-4c59-8a86-d84a6b5dc64f req-aaf46940-6634-4c89-8343-fbb2880db608 tempest-TestInstancesWithCinderVolumes-1135673885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-8e32e491-b90e-4c59-8a86-d84a6b5dc64f req-aaf46940-6634-4c89-8343-fbb2880db608 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.078s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:42 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-8e32e491-b90e-4c59-8a86-d84a6b5dc64f req-aaf46940-6634-4c89-8343-fbb2880db608 tempest-TestInstancesWithCinderVolumes-1135673885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-cef859d7-53cb-402d-9b63-3fbf1f46af94', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4891e09-8d28-4f9f-beb4-65ca7c586a24', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:18:42 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-8e32e491-b90e-4c59-8a86-d84a6b5dc64f req-aaf46940-6634-4c89-8343-fbb2880db608 tempest-TestInstancesWithCinderVolumes-1135673885 None] attachment_update completed successfully. Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Flow 'volume_create_manager' (fb846f35-53a9-4da1-b366-fc475a822f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084c8a10-5340-43c3-9e01-f15c244e3c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084c8a10-5340-43c3-9e01-f15c244e3c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1378106854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c68126c-3ff0-42df-8b3c-6cde04ea4c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b74fade87994acca99a810ad1711348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:43Z,use_quota=True,user_id='36babdc86e4a4ff4ab12ed929627407c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c00acd-789a-410c-b40d-e9007483d600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c00acd-789a-410c-b40d-e9007483d600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b3529a-3ee8-427a-9a1d-8894c1e651af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b3529a-3ee8-427a-9a1d-8894c1e651af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c68126c-3ff0-42df-8b3c-6cde04ea4c41', 'volume_name': 'volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41', 'volume_size': 2}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40efaa9c-0076-4705-8e47-8e27e64ec874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40efaa9c-0076-4705-8e47-8e27e64ec874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05e6675-06de-47cc-ad11-4e825675c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:42 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Volume 6c68126c-3ff0-42df-8b3c-6cde04ea4c41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41', 'volume_size': 2} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1378106854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c68126c-3ff0-42df-8b3c-6cde04ea4c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b74fade87994acca99a810ad1711348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:18:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:18:43Z,use_quota=True,user_id='36babdc86e4a4ff4ab12ed929627407c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Creating volume 6c68126c-3ff0-42df-8b3c-6cde04ea4c41 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:42 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:18:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:18:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:18:43 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:18:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 2147483648 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:43 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 2147483648 Jun 25 18:18:43 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-8e518f53-2fb6-4ef4-b131-bee55a400bc0 req-9b32baba-5e08-46aa-8f54-46500ecafd59 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:43 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 2147483648" returned: 0 in 0.982s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:44 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 Jun 25 18:18:44 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:44 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41" returned: 0 in 0.813s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:18:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-8e518f53-2fb6-4ef4-b131-bee55a400bc0 req-9b32baba-5e08-46aa-8f54-46500ecafd59 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.042s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05e6675-06de-47cc-ad11-4e825675c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41', 'volume_size': 2}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f9cffe-795f-4966-85af-ddbff8ed5e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:18:44 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea62fe1-54d3-473d-9720-3a56a6d1313e]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-8e518f53-2fb6-4ef4-b131-bee55a400bc0 req-9b32baba-5e08-46aa-8f54-46500ecafd59 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:44 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Volume volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 (6c68126c-3ff0-42df-8b3c-6cde04ea4c41): created successfully Jun 25 18:18:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f9cffe-795f-4966-85af-ddbff8ed5e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:18:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Flow 'volume_create_manager' (fb846f35-53a9-4da1-b366-fc475a822f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:18:44 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2ef98fcb-c329-40c9-a7f5-8244761c62c0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Created volume successfully. Jun 25 18:18:45 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3 Jun 25 18:18:45 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:18:45 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-8e518f53-2fb6-4ef4-b131-bee55a400bc0 req-9b32baba-5e08-46aa-8f54-46500ecafd59 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3" returned: 0 in 1.031s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-8e518f53-2fb6-4ef4-b131-bee55a400bc0 req-9b32baba-5e08-46aa-8f54-46500ecafd59 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.062s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.309s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:18:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Creating offline snapshot ab46656c-4524-46eb-9cca-d10cb4a53332 of volume 6c68126c-3ff0-42df-8b3c-6cde04ea4c41 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:18:45 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f434549-00fa-4503-b044-a803e71358df]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-8e518f53-2fb6-4ef4-b131-bee55a400bc0 req-9b32baba-5e08-46aa-8f54-46500ecafd59 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-560f1982-5d36-4697-957a-0b04b34d7af3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0c8832a-b6a8-4bc2-8cc5-eb30ac898204', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:18:46 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-8e518f53-2fb6-4ef4-b131-bee55a400bc0 req-9b32baba-5e08-46aa-8f54-46500ecafd59 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] attachment_update completed successfully. Jun 25 18:18:46 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 Jun 25 18:18:46 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:46 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41" returned: 0 in 0.850s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 2G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:46 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 2G Jun 25 18:18:46 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:47 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 2G" returned: 0 in 0.990s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:47 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 Jun 25 18:18:47 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:48 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332" returned: 0 in 0.804s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:48 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 is being set with open permissions: ugo+rw Jun 25 18:18:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:48 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 Jun 25 18:18:48 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:49 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332" returned: 0 in 0.922s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:49 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.info Jun 25 18:18:49 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:50 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.info" returned: 0 in 1.258s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:50 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.info is being set with open permissions: ugo+rw Jun 25 18:18:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:50 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.info Jun 25 18:18:50 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:52 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.info" returned: 0 in 1.394s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.404s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:18:52 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-9e9d2bb8-8b3c-400e-a62e-858c5e3ac2a0 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Create snapshot completed successfully Jun 25 18:18:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Acquiring lock "cinder-ab46656c-4524-46eb-9cca-d10cb4a53332-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "cinder-ab46656c-4524-46eb-9cca-d10cb4a53332-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Acquiring lock "cinder-quobyte-6c68126c-3ff0-42df-8b3c-6cde04ea4c41" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "cinder-quobyte-6c68126c-3ff0-42df-8b3c-6cde04ea4c41" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Acquiring lock "cinder-quobyte-ab46656c-4524-46eb-9cca-d10cb4a53332" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "cinder-quobyte-ab46656c-4524-46eb-9cca-d10cb4a53332" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Deleting offline snapshot ab46656c-4524-46eb-9cca-d10cb4a53332 of volume 6c68126c-3ff0-42df-8b3c-6cde04ea4c41 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:18:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] snapshot_file for this snap is: volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:18:53 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a54734f-034e-4a16-b10e-df8717bdd32d]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:53 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 Jun 25 18:18:53 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:55 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332" returned: 0 in 1.568s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:18:55 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6e1555-d4fa-4671-b4e6-c0153a5f180a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:55 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 Jun 25 18:18:55 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:55 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-210217ea-548a-4e12-a8ee-d2076f152a97 req-743e38b9-5ecc-4a42-a99f-6a128e7c1eb5 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Terminate volume connection completed successfully. Jun 25 18:18:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-210217ea-548a-4e12-a8ee-d2076f152a97 req-743e38b9-5ecc-4a42-a99f-6a128e7c1eb5 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Deleting attachment b0c8832a-b6a8-4bc2-8cc5-eb30ac898204. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:18:56 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41" returned: 0 in 1.456s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:56 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 Jun 25 18:18:56 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Acquiring lock "cinder-560f1982-5d36-4697-957a-0b04b34d7af3-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Lock "cinder-560f1982-5d36-4697-957a-0b04b34d7af3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Acquiring lock "cinder-quobyte-560f1982-5d36-4697-957a-0b04b34d7af3" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:18:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Lock "cinder-quobyte-560f1982-5d36-4697-957a-0b04b34d7af3" acquired by "delete_volume" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:18:57 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[212dcd62-93f4-4d9b-9d88-165198d4efcb]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:18:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:57 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3 Jun 25 18:18:57 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:58 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332" returned: 0 in 1.440s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:58 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332 Jun 25 18:18:58 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:59 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3" returned: 0 in 1.649s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:18:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:18:59 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3 Jun 25 18:18:59 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:18:59 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jun 25 18:18:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41.ab46656c-4524-46eb-9cca-d10cb4a53332" returned: 0 in 1.755s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "cinder-quobyte-ab46656c-4524-46eb-9cca-d10cb4a53332" released by "_delete_snapshot" :: held 6.469s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "cinder-quobyte-6c68126c-3ff0-42df-8b3c-6cde04ea4c41" released by "delete_snapshot" :: held 6.528s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:00 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Created reservations ['87455848-6c45-41ae-ad18-232f358dc428', '600db8d1-4067-4646-8a77-5f6fa0038da6', 'ea7b7bd1-8b35-4362-a6c8-12ba9ab06cbe', '46788893-c575-4db1-ae00-dc5796ee7565'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:19:00 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Delete snapshot completed successfully. Jun 25 18:19:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a8533337-8fba-4a12-846a-25bba06bb034 tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "cinder-ab46656c-4524-46eb-9cca-d10cb4a53332-delete_snapshot" released by "delete_snapshot" :: held 6.894s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:00 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-560f1982-5d36-4697-957a-0b04b34d7af3" returned: 0 in 1.246s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Lock "cinder-quobyte-560f1982-5d36-4697-957a-0b04b34d7af3" released by "delete_volume" :: held 2.990s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:00 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Created reservations ['2f230554-3034-45d0-a723-9f1a60e6bf7b', 'aeef0733-e9af-4b5d-a85a-39be2a73f63c', '0d9f937d-abab-4f60-9883-e67bd4fdb65a', 'f8edb90f-c333-46ad-9709-156c106e6974'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:19:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:19:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:19:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:00 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:19:00 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Flow 'volume_create_manager' (66431c8d-30ec-4d50-8862-82c4656347b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbcbee2-ac04-491b-8aac-52afdf2d9b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbcbee2-ac04-491b-8aac-52afdf2d9b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-826706867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8fab8b8-4c27-4d52-b8dd-9f76e110ec54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf3bff10dc6f49e18feece44fe213545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:19:01Z,use_quota=True,user_id='e5acd4d7a0564ba1bd0e4b9d8c5485b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c229ff-0eae-45fa-8d4c-421f0f6fc531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c229ff-0eae-45fa-8d4c-421f0f6fc531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1c9f9f-c09a-4e1f-bcfb-27cbb0fd1cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1c9f9f-c09a-4e1f-bcfb-27cbb0fd1cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8fab8b8-4c27-4d52-b8dd-9f76e110ec54', 'volume_name': 'volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054aaa9b-0a3f-4770-a630-f7a2c72e5478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054aaa9b-0a3f-4770-a630-f7a2c72e5478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57be5e83-a70a-49e8-a42a-47190c9e162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:01 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Volume b8fab8b8-4c27-4d52-b8dd-9f76e110ec54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54', 'volume_size': 1} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-826706867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8fab8b8-4c27-4d52-b8dd-9f76e110ec54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf3bff10dc6f49e18feece44fe213545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:19:01Z,use_quota=True,user_id='e5acd4d7a0564ba1bd0e4b9d8c5485b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Creating volume b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:19:01 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:01 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 1073741824 Jun 25 18:19:01 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Acquiring lock "cinder-6c68126c-3ff0-42df-8b3c-6cde04ea4c41-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "cinder-6c68126c-3ff0-42df-8b3c-6cde04ea4c41-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Acquiring lock "cinder-quobyte-6c68126c-3ff0-42df-8b3c-6cde04ea4c41" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "cinder-quobyte-6c68126c-3ff0-42df-8b3c-6cde04ea4c41" acquired by "delete_volume" :: waited 0.032s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c264d67-4647-4025-8ba3-ca265c607c9e]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:01 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 Jun 25 18:19:01 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:02 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.508s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:02 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:19:02 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Deleted volume successfully. Jun 25 18:19:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1a00971b-5a71-4d56-bd23-e6ca1d7e3d83 tempest-TestServerVolumeAttachScenarioOldVersion-1655366934 None] Lock "cinder-560f1982-5d36-4697-957a-0b04b34d7af3-delete_volume" released by "delete_volume" :: held 4.891s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:03 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 1073741824" returned: 0 in 1.886s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:03 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 Jun 25 18:19:03 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:03 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41" returned: 0 in 1.886s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:03 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41 Jun 25 18:19:03 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:04 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" returned: 0 in 1.208s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] <== create_volume: return (3170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:19:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.175s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57be5e83-a70a-49e8-a42a-47190c9e162e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac4e72f-7aef-449b-a660-3f08a5b40d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:04 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Volume volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 (b8fab8b8-4c27-4d52-b8dd-9f76e110ec54): created successfully Jun 25 18:19:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac4e72f-7aef-449b-a660-3f08a5b40d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Flow 'volume_create_manager' (66431c8d-30ec-4d50-8862-82c4656347b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:19:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-5950e1f0-7375-4abf-abac-3758d1811f97 tempest-VolumesActionsTest-1779954688 None] Created volume successfully. Jun 25 18:19:04 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6c68126c-3ff0-42df-8b3c-6cde04ea4c41" returned: 0 in 1.199s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "cinder-quobyte-6c68126c-3ff0-42df-8b3c-6cde04ea4c41" released by "delete_volume" :: held 3.207s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:04 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Created reservations ['d59b4bc9-b1f5-4fd1-b90a-4b3ce7b22acc', 'e5fbff45-7962-4e91-b505-184ff9fff784', '27e52308-b857-47b9-8c97-9276a43c05d3', '4b2ed60b-12a1-420f-8c50-c94b424948f2'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:19:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:19:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:19:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:05 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:19:05 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:06 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.111s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:06 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:19:06 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Deleted volume successfully. Jun 25 18:19:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-43d60119-1ca4-4287-be9e-0302e13da46f tempest-VolumesSnapshotNegativeTestJSON-525661073 None] Lock "cinder-6c68126c-3ff0-42df-8b3c-6cde04ea4c41-delete_volume" released by "delete_volume" :: held 4.851s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:14 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:INSERT=14,cinder:UPDATE=61,cinder:DELETE=8,cinder:SELECT=60 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:19:16 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:DELETE=6,cinder:UPDATE=97,cinder:SELECT=72,cinder:INSERT=29 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:19:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-08199b0f-610f-49bf-9d63-1cdc6493259f req-78896f90-67a4-467d-a3f3-13245d161f12 tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-08199b0f-610f-49bf-9d63-1cdc6493259f req-78896f90-67a4-467d-a3f3-13245d161f12 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:24 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[424d9c8f-4d7d-4f99-8374-c3f0448513aa]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-08199b0f-610f-49bf-9d63-1cdc6493259f req-78896f90-67a4-467d-a3f3-13245d161f12 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:24 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01 Jun 25 18:19:24 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:25 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-08199b0f-610f-49bf-9d63-1cdc6493259f req-78896f90-67a4-467d-a3f3-13245d161f12 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01" returned: 0 in 1.537s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-08199b0f-610f-49bf-9d63-1cdc6493259f req-78896f90-67a4-467d-a3f3-13245d161f12 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.572s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-08199b0f-610f-49bf-9d63-1cdc6493259f req-78896f90-67a4-467d-a3f3-13245d161f12 tempest-TestInstancesWithCinderVolumes-1135673885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-883f5e57-425a-4c4f-84f7-e13a71f33a01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbd4bc25-c211-488b-ba4a-9a1c9d489fdb', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:19:25 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-08199b0f-610f-49bf-9d63-1cdc6493259f req-78896f90-67a4-467d-a3f3-13245d161f12 tempest-TestInstancesWithCinderVolumes-1135673885 None] attachment_update completed successfully. Jun 25 18:19:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-fa3eaeb6-108d-4087-aff8-6e7c047e2e31 req-d2a274fa-9598-423d-b41f-13a246de9c02 tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-fa3eaeb6-108d-4087-aff8-6e7c047e2e31 req-d2a274fa-9598-423d-b41f-13a246de9c02 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:34 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[8011901b-705d-4aaa-8464-ad782475656e]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-fa3eaeb6-108d-4087-aff8-6e7c047e2e31 req-d2a274fa-9598-423d-b41f-13a246de9c02 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:35 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df Jun 25 18:19:35 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:36 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-fa3eaeb6-108d-4087-aff8-6e7c047e2e31 req-d2a274fa-9598-423d-b41f-13a246de9c02 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df" returned: 0 in 1.585s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-fa3eaeb6-108d-4087-aff8-6e7c047e2e31 req-d2a274fa-9598-423d-b41f-13a246de9c02 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.618s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-fa3eaeb6-108d-4087-aff8-6e7c047e2e31 req-d2a274fa-9598-423d-b41f-13a246de9c02 tempest-TestInstancesWithCinderVolumes-1135673885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-11da3b96-decb-48dd-865b-7507ea9cd9df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9cb80149-0ead-4d4f-a799-0b33a1f74cec', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:19:36 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-fa3eaeb6-108d-4087-aff8-6e7c047e2e31 req-d2a274fa-9598-423d-b41f-13a246de9c02 tempest-TestInstancesWithCinderVolumes-1135673885 None] attachment_update completed successfully. Jun 25 18:19:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-05ff14a4-5049-4a06-af0f-eda4db191e6c tempest-VolumesActionsTest-1779954688 None] Acquiring lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" by "attach_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-05ff14a4-5049-4a06-af0f-eda4db191e6c tempest-VolumesActionsTest-1779954688 None] Lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" acquired by "attach_volume" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:39 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-05ff14a4-5049-4a06-af0f-eda4db191e6c tempest-VolumesActionsTest-1779954688 None] Attaching volume b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 to instance 1a4a3d85-04dc-48ae-8078-e66d5681fa1d at mountpoint /dev/vdb on host None. Jun 25 18:19:39 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-05ff14a4-5049-4a06-af0f-eda4db191e6c tempest-VolumesActionsTest-1779954688 None] Attach volume completed successfully. Jun 25 18:19:39 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-05ff14a4-5049-4a06-af0f-eda4db191e6c tempest-VolumesActionsTest-1779954688 None] Lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" released by "attach_volume" :: held 0.161s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:19:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:19:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:19:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:39 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:19:39 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:39 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e682547d-c251-4bd8-a2db-6cc5462a0942 tempest-VolumesActionsTest-1779954688 None] Acquiring lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54-detach_volume" by "detach_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:39 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e682547d-c251-4bd8-a2db-6cc5462a0942 tempest-VolumesActionsTest-1779954688 None] Lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:39 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e682547d-c251-4bd8-a2db-6cc5462a0942 tempest-VolumesActionsTest-1779954688 None] Detaching volume b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 from instance 1a4a3d85-04dc-48ae-8078-e66d5681fa1d. Jun 25 18:19:39 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e682547d-c251-4bd8-a2db-6cc5462a0942 tempest-VolumesActionsTest-1779954688 None] Detach volume completed successfully. Jun 25 18:19:39 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e682547d-c251-4bd8-a2db-6cc5462a0942 tempest-VolumesActionsTest-1779954688 None] Lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:40 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.599s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:19:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:19:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 28 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:19:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Flow 'volume_create_manager' (08384eda-878a-43fe-84bb-6f84f9068fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f399a2-04c7-42cd-84da-3c0629d32fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f399a2-04c7-42cd-84da-3c0629d32fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-28529771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd279dff-94d9-42cc-9397-bcb17c93ab5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe63fb1f3e94fb3944e935564bded9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:19:46Z,use_quota=True,user_id='e782f10b680a495dacfe7172c252d9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f68f3bc-db77-40e3-88dc-0900ed5d6afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f68f3bc-db77-40e3-88dc-0900ed5d6afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdafb069-1279-4e4d-8e87-6c4b12989065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdafb069-1279-4e4d-8e87-6c4b12989065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd279dff-94d9-42cc-9397-bcb17c93ab5d', 'volume_name': 'volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee72cbc-37ad-4ac7-8954-05d447a5b648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee72cbc-37ad-4ac7-8954-05d447a5b648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808e4249-a0ae-421b-afa7-210e408c7889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:46 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Volume bd279dff-94d9-42cc-9397-bcb17c93ab5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d', 'volume_size': 1} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-28529771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd279dff-94d9-42cc-9397-bcb17c93ab5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe63fb1f3e94fb3944e935564bded9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:19:46Z,use_quota=True,user_id='e782f10b680a495dacfe7172c252d9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Creating volume bd279dff-94d9-42cc-9397-bcb17c93ab5d {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:19:46 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:19:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:46 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d 1073741824 Jun 25 18:19:46 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:48 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d 1073741824" returned: 0 in 1.376s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:48 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d Jun 25 18:19:48 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:48 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-a5242776-c9f9-42ba-b95e-f15d9f32ce11 req-578c7b1a-1a7e-434f-894c-f787a4ca9535 tempest-TestInstancesWithCinderVolumes-1135673885 None] Terminate volume connection completed successfully. Jun 25 18:19:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a5242776-c9f9-42ba-b95e-f15d9f32ce11 req-578c7b1a-1a7e-434f-894c-f787a4ca9535 tempest-TestInstancesWithCinderVolumes-1135673885 None] Deleting attachment fbd4bc25-c211-488b-ba4a-9a1c9d489fdb. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:19:49 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d" returned: 0 in 1.359s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] <== create_volume: return (2850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:19:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.854s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808e4249-a0ae-421b-afa7-210e408c7889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a71cfc-53d6-424e-866b-1fa12e35a3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:19:49 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Volume volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d (bd279dff-94d9-42cc-9397-bcb17c93ab5d): created successfully Jun 25 18:19:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a71cfc-53d6-424e-866b-1fa12e35a3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:19:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Flow 'volume_create_manager' (08384eda-878a-43fe-84bb-6f84f9068fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:19:49 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2ca6598e-c795-4736-99b1-6a646b1444bb tempest-TestStampPattern-177067603 None] Created volume successfully. Jun 25 18:19:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "cinder-883f5e57-425a-4c4f-84f7-e13a71f33a01-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "cinder-883f5e57-425a-4c4f-84f7-e13a71f33a01-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "cinder-quobyte-883f5e57-425a-4c4f-84f7-e13a71f33a01" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:19:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "cinder-quobyte-883f5e57-425a-4c4f-84f7-e13a71f33a01" acquired by "delete_volume" :: waited 0.038s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:19:50 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd425a1e-e8bb-40f4-8ae0-80b36a8959c4]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:19:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:50 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01 Jun 25 18:19:50 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:51 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01" returned: 0 in 1.233s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:51 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01 Jun 25 18:19:51 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:52 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-883f5e57-425a-4c4f-84f7-e13a71f33a01" returned: 0 in 0.972s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "cinder-quobyte-883f5e57-425a-4c4f-84f7-e13a71f33a01" released by "delete_volume" :: held 2.325s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:52 devstack cinder-volume[93651]: WARNING cinder.quota [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538858522-686493807 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538858522-686493807, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:19:52 devstack cinder-volume[93651]: WARNING cinder.quota [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538858522-686493807 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1538858522-686493807, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:19:52 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Created reservations ['9c0d7159-9d01-4d2f-99f9-92612261fc5b', 'b2a3ad6d-ffca-40e0-ab42-81689bf53587', 'd70f418d-8ee0-41d7-92ab-b7bf33fd5888', 'ebdebf41-4ca5-43c0-a5c7-9feae4458065'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:19:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:19:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:19:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:19:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:19:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:19:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:19:52 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:19:52 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:19:53 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jun 25 18:19:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.903s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:19:53 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:19:53 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Deleted volume successfully. Jun 25 18:19:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c5255aff-dd0c-48b7-a42a-e6cb8361a67f tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "cinder-883f5e57-425a-4c4f-84f7-e13a71f33a01-delete_volume" released by "delete_volume" :: held 3.564s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:19:56 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-0d29a78b-7cea-4003-81dd-071392cff02c req-5de213d0-d46a-4a44-8a96-e206e3feb20b tempest-TestInstancesWithCinderVolumes-1135673885 None] Terminate volume connection completed successfully. Jun 25 18:19:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-0d29a78b-7cea-4003-81dd-071392cff02c req-5de213d0-d46a-4a44-8a96-e206e3feb20b tempest-TestInstancesWithCinderVolumes-1135673885 None] Deleting attachment 9cb80149-0ead-4d4f-a799-0b33a1f74cec. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:20:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "cinder-11da3b96-decb-48dd-865b-7507ea9cd9df-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "cinder-11da3b96-decb-48dd-865b-7507ea9cd9df-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "cinder-quobyte-11da3b96-decb-48dd-865b-7507ea9cd9df" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "cinder-quobyte-11da3b96-decb-48dd-865b-7507ea9cd9df" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:02 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e4dfee-0241-41c4-b8c5-08d8cbd40fc9]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:02 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df Jun 25 18:20:02 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:02 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:20:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Flow 'volume_create_manager' (a14afdd8-75a2-442a-ae11-c04960e07a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:20:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2abd39-c53b-4cc9-b701-3705eeccafac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2abd39-c53b-4cc9-b701-3705eeccafac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-853404439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='052af275de314bddaab9dd3fde52848d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:20:03Z,use_quota=True,user_id='fc4ebaf2b9e9414682a7c5b2002e8f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c06fa0-41d8-4815-bc23-420ed77be4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c06fa0-41d8-4815-bc23-420ed77be4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3504e5c6-9b78-417d-b9f0-875257c2cea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3504e5c6-9b78-417d-b9f0-875257c2cea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c', 'volume_name': 'volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bba9eb-d4e4-4434-a77c-51eeea2760c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bba9eb-d4e4-4434-a77c-51eeea2760c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9323d77c-0fa8-4bb9-9567-5325a5a1ed95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:03 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Volume d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c', 'volume_size': 1} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-853404439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='052af275de314bddaab9dd3fde52848d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:20:03Z,use_quota=True,user_id='fc4ebaf2b9e9414682a7c5b2002e8f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Creating volume d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:20:03 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:03 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c 1073741824 Jun 25 18:20:03 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:03 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df" returned: 0 in 1.455s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:03 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df Jun 25 18:20:03 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Flow 'volume_create_manager' (481961f0-6b1d-47a5-ac67-dc766695b1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfc046f-4a23-4ead-a415-1fda5be52adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfc046f-4a23-4ead-a415-1fda5be52adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2015180437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ab74e5-f5b2-46f6-a622-ed273cc65170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='052af275de314bddaab9dd3fde52848d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:20:04Z,use_quota=True,user_id='fc4ebaf2b9e9414682a7c5b2002e8f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9179c88-134f-4df9-acf8-377b7fc49e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9179c88-134f-4df9-acf8-377b7fc49e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9799d1b5-2a59-42af-b021-8e0e8e94dae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9799d1b5-2a59-42af-b021-8e0e8e94dae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ab74e5-f5b2-46f6-a622-ed273cc65170', 'volume_name': 'volume-28ab74e5-f5b2-46f6-a622-ed273cc65170', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd951a3-70d2-4557-947d-03c9b170e09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd951a3-70d2-4557-947d-03c9b170e09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b82cb61-e2af-4d75-a632-db927466c184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:03 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Volume 28ab74e5-f5b2-46f6-a622-ed273cc65170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ab74e5-f5b2-46f6-a622-ed273cc65170', 'volume_size': 1} Jun 25 18:20:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:04 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c 1073741824" returned: 0 in 1.308s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:04 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c Jun 25 18:20:04 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:04 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-11da3b96-decb-48dd-865b-7507ea9cd9df" returned: 0 in 1.023s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "cinder-quobyte-11da3b96-decb-48dd-865b-7507ea9cd9df" released by "delete_volume" :: held 2.575s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:04 devstack cinder-volume[93651]: WARNING cinder.quota [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-84508119-1333109954 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-84508119-1333109954, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:20:04 devstack cinder-volume[93651]: WARNING cinder.quota [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-84508119-1333109954 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-84508119-1333109954, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:20:04 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Created reservations ['49aa69aa-fdc2-499f-a2f9-a75a910ca3d9', 'e8057d8e-87d5-4841-bdbd-031065eb3665', '375a2c93-5e4d-4bde-8411-6f6733ee2be2', '8cfcd637-4078-4d21-b419-e581d757c504'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:20:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:20:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:20:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:04 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:20:04 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:05 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c" returned: 0 in 1.066s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] <== create_volume: return (2435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.443s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.762s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2015180437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ab74e5-f5b2-46f6-a622-ed273cc65170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='052af275de314bddaab9dd3fde52848d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:20:04Z,use_quota=True,user_id='fc4ebaf2b9e9414682a7c5b2002e8f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Creating volume 28ab74e5-f5b2-46f6-a622-ed273cc65170 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:20:05 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9323d77c-0fa8-4bb9-9567-5325a5a1ed95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:05 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170 1073741824 Jun 25 18:20:05 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6afb46e9-1458-4d22-9f0e-21313c381b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:05 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Volume volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c (d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c): created successfully Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6afb46e9-1458-4d22-9f0e-21313c381b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:05 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Flow 'volume_create_manager' (a14afdd8-75a2-442a-ae11-c04960e07a36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:20:05 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-01c0eeae-bd5a-4e07-9283-a4c50e9ce0c0 tempest-TestServerVolumeAttachmentScenario-296268262 None] Created volume successfully. Jun 25 18:20:06 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.365s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:06 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:20:06 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Deleted volume successfully. Jun 25 18:20:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7913d98a-3ad4-4d02-92c7-58423ca94477 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "cinder-11da3b96-decb-48dd-865b-7507ea9cd9df-delete_volume" released by "delete_volume" :: held 4.377s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:06 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170 1073741824" returned: 0 in 1.370s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:06 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170 Jun 25 18:20:06 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:07 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170" returned: 0 in 0.962s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] <== create_volume: return (2406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:20:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.409s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b82cb61-e2af-4d75-a632-db927466c184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ab74e5-f5b2-46f6-a622-ed273cc65170', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15d83d0-b5e2-41e7-8f61-7ac4bd7b612c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:20:07 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Volume volume-28ab74e5-f5b2-46f6-a622-ed273cc65170 (28ab74e5-f5b2-46f6-a622-ed273cc65170): created successfully Jun 25 18:20:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15d83d0-b5e2-41e7-8f61-7ac4bd7b612c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:20:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Flow 'volume_create_manager' (481961f0-6b1d-47a5-ac67-dc766695b1a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:20:07 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e1bcfc2f-33f2-467a-8de5-653827761468 tempest-TestServerVolumeAttachmentScenario-296268262 None] Created volume successfully. Jun 25 18:20:13 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-0d93ce6d-64cd-4960-b5ce-395228eebe6f req-c269a475-e332-452d-85bf-05b3bdb7b113 tempest-TestInstancesWithCinderVolumes-1135673885 None] Terminate volume connection completed successfully. Jun 25 18:20:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-0d93ce6d-64cd-4960-b5ce-395228eebe6f req-c269a475-e332-452d-85bf-05b3bdb7b113 tempest-TestInstancesWithCinderVolumes-1135673885 None] Deleting attachment e4891e09-8d28-4f9f-beb4-65ca7c586a24. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:20:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "cinder-cef859d7-53cb-402d-9b63-3fbf1f46af94-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "cinder-cef859d7-53cb-402d-9b63-3fbf1f46af94-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:17 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=32,cinder:UPDATE=37,cinder:INSERT=6,cinder:DELETE=2 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:20:17 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=42,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=3 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:20:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "cinder-quobyte-cef859d7-53cb-402d-9b63-3fbf1f46af94" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "cinder-quobyte-cef859d7-53cb-402d-9b63-3fbf1f46af94" acquired by "delete_volume" :: waited 0.028s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:17 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceac4196-a72b-4597-a4d4-3a79d07686a6]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:17 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 Jun 25 18:20:17 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-63326393-8fff-499b-a401-7493e6734008 tempest-VolumesActionsTest-1779954688 None] Acquiring lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" by "attach_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-63326393-8fff-499b-a401-7493e6734008 tempest-VolumesActionsTest-1779954688 None] Lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" acquired by "attach_volume" :: waited 0.049s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:18 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-63326393-8fff-499b-a401-7493e6734008 tempest-VolumesActionsTest-1779954688 None] Attaching volume b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 to instance 1ea170d4-6a2d-45ba-bb10-a19155c90636 at mountpoint /dev/vdb on host None. Jun 25 18:20:18 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-63326393-8fff-499b-a401-7493e6734008 tempest-VolumesActionsTest-1779954688 None] Attach volume completed successfully. Jun 25 18:20:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-63326393-8fff-499b-a401-7493e6734008 tempest-VolumesActionsTest-1779954688 None] Lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" released by "attach_volume" :: held 0.188s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a86beb9d-251e-43e7-a3f3-989e2538f7f6 tempest-VolumesActionsTest-1779954688 None] Acquiring lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54-detach_volume" by "detach_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:20:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a86beb9d-251e-43e7-a3f3-989e2538f7f6 tempest-VolumesActionsTest-1779954688 None] Lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:20:18 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-a86beb9d-251e-43e7-a3f3-989e2538f7f6 tempest-VolumesActionsTest-1779954688 None] Detaching volume b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 from instance 1ea170d4-6a2d-45ba-bb10-a19155c90636. Jun 25 18:20:19 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-a86beb9d-251e-43e7-a3f3-989e2538f7f6 tempest-VolumesActionsTest-1779954688 None] Detach volume completed successfully. Jun 25 18:20:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a86beb9d-251e-43e7-a3f3-989e2538f7f6 tempest-VolumesActionsTest-1779954688 None] Lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54-detach_volume" released by "detach_volume" :: held 0.123s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:19 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94" returned: 0 in 1.673s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:19 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 Jun 25 18:20:19 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:21 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94" returned: 1 in 2.605s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:20:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:21 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94 Jun 25 18:20:21 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:22 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cef859d7-53cb-402d-9b63-3fbf1f46af94" returned: 0 in 1.202s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:22 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "cinder-quobyte-cef859d7-53cb-402d-9b63-3fbf1f46af94" released by "delete_volume" :: held 5.642s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:23 devstack cinder-volume[93651]: WARNING cinder.quota [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1848901063-971323900 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1848901063-971323900, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:20:23 devstack cinder-volume[93651]: WARNING cinder.quota [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1848901063-971323900 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1848901063-971323900, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:20:23 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Created reservations ['e0ac9d1d-5a44-47fa-aa54-ef6d29893f69', '4f16a078-3e08-42a2-93a9-f78ca4b988a3', '216be16a-bd37-4477-a14d-600eebc7fada', 'a40be494-5135-47d4-87a9-6a683a636bb5'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:20:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:20:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:20:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:23 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:20:23 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:24 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.220s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:24 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:20:24 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Deleted volume successfully. Jun 25 18:20:24 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-622a67a7-29b6-48f2-9c64-527b9a1b9b53 tempest-TestInstancesWithCinderVolumes-1135673885 None] Lock "cinder-cef859d7-53cb-402d-9b63-3fbf1f46af94-delete_volume" released by "delete_volume" :: held 7.276s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:20:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:30 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[d433e38d-d583-41de-8001-aa2576bb9463]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:30 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 Jun 25 18:20:30 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:31 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" returned: 0 in 1.265s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:32 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[74485be9-a238-4a43-bae4-cb589f66ea25]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:32 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 Jun 25 18:20:32 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:33 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" returned: 0 in 1.255s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.d7d5579e-594a-457b-a24d-fa67d67e70d5fqthjjmj.img {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:33 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.d7d5579e-594a-457b-a24d-fa67d67e70d5fqthjjmj.img Jun 25 18:20:33 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:34 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=15,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:20:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:20:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:20:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:20:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:20:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:20:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:39 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:20:39 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-5533a963-64f7-46d3-b0dd-b5061ca9f1bb req-90dc2c41-107b-4960-b952-e52cde09639a tempest-TestStampPattern-177067603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:20:41 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.d7d5579e-594a-457b-a24d-fa67d67e70d5fqthjjmj.img" returned: 0 in 8.283s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:41 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a80f19-99df-4f1f-96bc-c5cba36ceea2]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:20:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:20:41 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 2.366s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:41 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:20:41 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:20:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 28 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:20:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:20:41 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 Jun 25 18:20:41 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:20:42 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jun 25 18:20:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" returned: 0 in 1.258s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:20:42 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] Image conversion details: src /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54, size 1024.00 MB, duration 8.29 sec, destination /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.d7d5579e-594a-457b-a24d-fa67d67e70d5fqthjjmj.img {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:20:42 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] Converted 1024.00 MB image at 123.59 MB/s Jun 25 18:20:42 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] d7d5579e-594a-457b-a24d-fa67d67e70d5 was raw, no need to convert to raw {{(pid=93651) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 25 18:20:52 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=2 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:20:52 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:INSERT=4,cinder:UPDATE=9,cinder:SELECT=11 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:21:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-018e5708-c9ae-410f-8775-34cf19ea77a1 req-15a48ba4-0094-479c-b716-565c5b8bc0ff tempest-TestServerVolumeAttachmentScenario-296268262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.479s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] Uploaded volume to glance image-id: d7d5579e-594a-457b-a24d-fa67d67e70d5. {{(pid=93651) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1811}} Jun 25 18:21:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-5533a963-64f7-46d3-b0dd-b5061ca9f1bb req-90dc2c41-107b-4960-b952-e52cde09639a tempest-TestStampPattern-177067603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 26.738s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:07 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[944db0fc-ab59-4df1-82eb-62fc2001309c]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-5533a963-64f7-46d3-b0dd-b5061ca9f1bb req-90dc2c41-107b-4960-b952-e52cde09639a tempest-TestStampPattern-177067603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:07 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-1bb07257-0636-4767-b541-95a0be410837 tempest-VolumesActionsTest-1779954688 None] Copy volume to image completed successfully. Jun 25 18:21:07 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d Jun 25 18:21:07 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:08 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-5533a963-64f7-46d3-b0dd-b5061ca9f1bb req-90dc2c41-107b-4960-b952-e52cde09639a tempest-TestStampPattern-177067603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d" returned: 0 in 0.878s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-5533a963-64f7-46d3-b0dd-b5061ca9f1bb req-90dc2c41-107b-4960-b952-e52cde09639a tempest-TestStampPattern-177067603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.911s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-018e5708-c9ae-410f-8775-34cf19ea77a1 req-15a48ba4-0094-479c-b716-565c5b8bc0ff tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.391s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:08 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f5f88f-a424-4765-9220-5a0af0f27990]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-018e5708-c9ae-410f-8775-34cf19ea77a1 req-15a48ba4-0094-479c-b716-565c5b8bc0ff tempest-TestServerVolumeAttachmentScenario-296268262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-5533a963-64f7-46d3-b0dd-b5061ca9f1bb req-90dc2c41-107b-4960-b952-e52cde09639a tempest-TestStampPattern-177067603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92134d6f-dd4b-4f9f-96b3-5d61ec71ab96', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:21:08 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-5533a963-64f7-46d3-b0dd-b5061ca9f1bb req-90dc2c41-107b-4960-b952-e52cde09639a tempest-TestStampPattern-177067603 None] attachment_update completed successfully. Jun 25 18:21:08 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c Jun 25 18:21:08 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:09 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-018e5708-c9ae-410f-8775-34cf19ea77a1 req-15a48ba4-0094-479c-b716-565c5b8bc0ff tempest-TestServerVolumeAttachmentScenario-296268262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c" returned: 0 in 1.069s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-018e5708-c9ae-410f-8775-34cf19ea77a1 req-15a48ba4-0094-479c-b716-565c5b8bc0ff tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.097s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-018e5708-c9ae-410f-8775-34cf19ea77a1 req-15a48ba4-0094-479c-b716-565c5b8bc0ff tempest-TestServerVolumeAttachmentScenario-296268262 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46aca288-8a93-493d-bea6-fda22f4aae1d', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:21:09 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-018e5708-c9ae-410f-8775-34cf19ea77a1 req-15a48ba4-0094-479c-b716-565c5b8bc0ff tempest-TestServerVolumeAttachmentScenario-296268262 None] attachment_update completed successfully. Jun 25 18:21:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:10 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccfd7a0-b66c-4c3a-9ea7-a2b4c4026d23]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:10 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 Jun 25 18:21:10 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:11 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" returned: 0 in 1.030s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:11 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e82ed52-dfeb-49e6-9831-655c3ebcb65a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:11 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 Jun 25 18:21:11 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:12 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" returned: 0 in 0.959s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:12 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img Jun 25 18:21:12 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:18 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img" returned: 0 in 6.800s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:18 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[440edf2f-33e3-43cb-86cb-ee0e372afaec]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:19 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 Jun 25 18:21:19 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:19 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:21:19 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:21:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Flow 'volume_create_manager' (2e0fa542-8842-4bf8-88cf-97d83da3003c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040dd574-7229-4a2c-8393-118d8884dc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040dd574-7229-4a2c-8393-118d8884dc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-290862741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efdc544-edc8-4ffd-9452-881348c116b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067ed77a9149439b9f651d9f8565506e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:19Z,use_quota=True,user_id='84d2c07e09fe4e2bafb90f39a6c5cf1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e6ea67-7709-412e-9e56-31fb266ae457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e6ea67-7709-412e-9e56-31fb266ae457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:19 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314bc000-d14e-47b3-95bd-2a58ed76e0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:19 devstack cinder-volume[93651]: DEBUG cinder.image.glance [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Creating Keystone auth plugin from conf {{(pid=93651) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:21:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314bc000-d14e-47b3-95bd-2a58ed76e0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8efdc544-edc8-4ffd-9452-881348c116b8', 'volume_name': 'volume-8efdc544-edc8-4ffd-9452-881348c116b8', 'volume_size': 1, 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab240da4b4934e58a24c7f836ed62427', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'created_at': datetime.datetime(2026, 6, 25, 15, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 58, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e764c63c-15d9-4999-a47c-eec23c8b2a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e764c63c-15d9-4999-a47c-eec23c8b2a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07fd286-1182-42d9-994b-c47f67b37d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:20 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Volume 8efdc544-edc8-4ffd-9452-881348c116b8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8efdc544-edc8-4ffd-9452-881348c116b8', 'volume_size': 1, 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab240da4b4934e58a24c7f836ed62427', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'created_at': datetime.datetime(2026, 6, 25, 15, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 58, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 18:21:20 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Trying to clone 8efdc544-edc8-4ffd-9452-881348c116b8 from image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c at location (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]). {{(pid=93651) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:21:20 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" returned: 0 in 1.224s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:20 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Image conversion details: src /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54, size 1024.00 MB, duration 6.80 sec, destination /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:21:20 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Converted 1024.00 MB image at 150.57 MB/s Jun 25 18:21:20 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] 25405134-bf1e-43bc-950f-85977dc3aa9b was raw, converting to qcow2 {{(pid=93651) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 25 18:21:20 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[03518df1-1be4-41bf-8758-8783a3224404]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:20 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img Jun 25 18:21:20 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:20 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_z7cm5lugdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:21:20 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Image download 20.69 MB at 20.69 MB/s Jun 25 18:21:20 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[764bd6d9-05d6-46fa-a1d7-1677b91d6e4c]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_z7cm5lugdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:20 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_z7cm5lugdevstack@QuobyteHD Jun 25 18:21:20 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:20 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-57642886-d190-4201-a909-08da93f933d1 req-dc24e21f-7a9b-49c6-8bbc-64c0ca275d24 tempest-TestStampPattern-177067603 None] Terminate volume connection completed successfully. Jun 25 18:21:20 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-57642886-d190-4201-a909-08da93f933d1 req-dc24e21f-7a9b-49c6-8bbc-64c0ca275d24 tempest-TestStampPattern-177067603 None] Deleting attachment 92134d6f-dd4b-4f9f-96b3-5d61ec71ab96. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:21:21 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img" returned: 0 in 0.963s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:21 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img Jun 25 18:21:21 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:21 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_z7cm5lugdevstack@QuobyteHD" returned: 0 in 0.924s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:21 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Temporary image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c is fetched for user 84d2c07e09fe4e2bafb90f39a6c5cf1b. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:21:21 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d910a6-8b6e-478c-b457-f1507b881c58]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_z7cm5lugdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:21 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_z7cm5lugdevstack@QuobyteHD Jun 25 18:21:21 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:21 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img" returned: 1 in 0.793s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:21:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img /opt/stack/data/cinder/conversion/vol_upload_u7l17vxh {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:21 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img /opt/stack/data/cinder/conversion/vol_upload_u7l17vxh Jun 25 18:21:21 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:22 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_z7cm5lugdevstack@QuobyteHD" returned: 0 in 0.767s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:22 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img /opt/stack/data/cinder/conversion/vol_upload_u7l17vxh" returned: 0 in 0.741s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:22 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Image conversion details: src /opt/stack/data/cinder/conversion/b8fab8b8-4c27-4d52-b8dd-9f76e110ec54.temp_image.25405134-bf1e-43bc-950f-85977dc3aa9b6b45rtl_.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_u7l17vxh {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:21:22 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 25 18:21:22 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[2697a3a7-c359-41fb-9d62-9532235b53ef]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u7l17vxh {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:22 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u7l17vxh Jun 25 18:21:22 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:23 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u7l17vxh" returned: 0 in 0.776s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-ab201080-d0c2-4ece-a42a-3119f20a6277 req-e8bb960e-d5fd-42f7-8887-593b5c2edd94 tempest-TestServerVolumeAttachmentScenario-296268262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.830s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Uploaded volume to glance image-id: 25405134-bf1e-43bc-950f-85977dc3aa9b. {{(pid=93651) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1811}} Jun 25 18:21:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.510s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-290862741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efdc544-edc8-4ffd-9452-881348c116b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067ed77a9149439b9f651d9f8565506e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:19Z,use_quota=True,user_id='84d2c07e09fe4e2bafb90f39a6c5cf1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:21:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Creating volume 8efdc544-edc8-4ffd-9452-881348c116b8 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:21:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:21:24 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:21:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:24 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 1073741824 Jun 25 18:21:24 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:24 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-637b9388-a4e0-4fd0-90d7-750957615d7e tempest-VolumesActionsTest-1779954688 None] Copy volume to image completed successfully. Jun 25 18:21:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Acquiring lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Acquiring lock "cinder-quobyte-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Lock "cinder-quobyte-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" acquired by "delete_volume" :: waited 0.019s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:25 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c482e15-b7c1-4a4a-823e-6264bc57a0e3]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:25 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 1073741824" returned: 0 in 0.992s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:25 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 Jun 25 18:21:25 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 Jun 25 18:21:25 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:25 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:26 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8" returned: 0 in 0.799s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:21:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.782s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:26 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] Creating offline snapshot 8ab149af-8655-4ef2-8107-05d508a81714 of volume bd279dff-94d9-42cc-9397-bcb17c93ab5d {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:21:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" returned: 0 in 0.923s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:26 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe98690-6e68-4b78-92af-e37b8fa87ccc]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:26 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54 Jun 25 18:21:26 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:26 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Attempting download of 2834cfdd-f1d3-4acf-a5ec-74a95c79167c ((None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}])) to volume 8efdc544-edc8-4ffd-9452-881348c116b8. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:21:26 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb9827f-949e-40d4-9de9-0a3cec2417aa]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_mt5fpd07 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:26 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d Jun 25 18:21:26 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:26 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_mt5fpd07 Jun 25 18:21:26 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:27 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" returned: 0 in 0.732s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Lock "cinder-quobyte-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54" released by "delete_volume" :: held 1.735s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:27 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Created reservations ['d8845464-fce6-4cf3-bbb7-875b97d988a9', '3bb5a588-bc43-48ff-846c-1b6c94b57c4e', 'e46f2622-a4b6-440c-8af5-a49cc28a8100', 'dcb05221-1a18-421f-97d2-498076ea6c77'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:21:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:27 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d" returned: 0 in 0.939s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:27 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:21:27 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:27 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_mt5fpd07" returned: 0 in 0.866s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_mt5fpd07 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:27 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 1G Jun 25 18:21:27 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:27 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_mt5fpd07 Jun 25 18:21:27 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:28 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.788s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:28 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:21:28 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Deleted volume successfully. Jun 25 18:21:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e5ffb16f-54de-4451-9780-1ceadcdf249a tempest-VolumesActionsTest-1779954688 None] Lock "cinder-b8fab8b8-4c27-4d52-b8dd-9f76e110ec54-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:28 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_mt5fpd07" returned: 1 in 1.100s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_mt5fpd07' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:21:28 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[950dcdc9-98da-434a-8332-e66389619611]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_z7cm5lugdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:28 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 1G" returned: 0 in 1.281s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:29 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_z7cm5lugdevstack@QuobyteHD Jun 25 18:21:29 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:29 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 Jun 25 18:21:29 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:29 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_z7cm5lugdevstack@QuobyteHD" returned: 0 in 1.025s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:29 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] 2834cfdd-f1d3-4acf-a5ec-74a95c79167c was qcow2, converting to raw {{(pid=93651) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:21:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_z7cm5lugdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:29 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714" returned: 0 in 0.889s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:29 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 is being set with open permissions: ugo+rw Jun 25 18:21:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:29 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_z7cm5lugdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 Jun 25 18:21:29 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:29 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 Jun 25 18:21:29 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:30 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714" returned: 0 in 0.779s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:30 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.info Jun 25 18:21:30 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:31 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.info" returned: 0 in 1.112s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:31 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.info is being set with open permissions: ugo+rw Jun 25 18:21:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:31 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.info Jun 25 18:21:31 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:32 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.info" returned: 0 in 0.981s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.105s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-ab201080-d0c2-4ece-a42a-3119f20a6277 req-e8bb960e-d5fd-42f7-8887-593b5c2edd94 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.122s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:32 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a7ab76-cc70-4749-aa74-84b4e0be4b8d]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-ab201080-d0c2-4ece-a42a-3119f20a6277 req-e8bb960e-d5fd-42f7-8887-593b5c2edd94 tempest-TestServerVolumeAttachmentScenario-296268262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:32 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-0f4bea31-bb37-4496-bc11-f531fe504a0b tempest-TestStampPattern-177067603 None] Create snapshot completed successfully Jun 25 18:21:33 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_z7cm5lugdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8" returned: 0 in 3.157s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:33 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_z7cm5lugdevstack@QuobyteHD, size 112.00 MB, duration 3.16 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:21:33 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Converted 112.00 MB image at 35.47 MB/s Jun 25 18:21:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:33 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170 Jun 25 18:21:33 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:33 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 1G Jun 25 18:21:33 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:34 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-ab201080-d0c2-4ece-a42a-3119f20a6277 req-e8bb960e-d5fd-42f7-8887-593b5c2edd94 tempest-TestServerVolumeAttachmentScenario-296268262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170" returned: 0 in 1.246s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-ab201080-d0c2-4ece-a42a-3119f20a6277 req-e8bb960e-d5fd-42f7-8887-593b5c2edd94 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.295s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-ab201080-d0c2-4ece-a42a-3119f20a6277 req-e8bb960e-d5fd-42f7-8887-593b5c2edd94 tempest-TestServerVolumeAttachmentScenario-296268262 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-28ab74e5-f5b2-46f6-a622-ed273cc65170', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f8efefb-cb1c-451e-9d3a-d9b24d4568f2', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:21:34 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-ab201080-d0c2-4ece-a42a-3119f20a6277 req-e8bb960e-d5fd-42f7-8887-593b5c2edd94 tempest-TestServerVolumeAttachmentScenario-296268262 None] attachment_update completed successfully. Jun 25 18:21:34 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 1G" returned: 0 in 1.304s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:34 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5273dd-7b48-4dbf-a677-b37b13992d97]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:34 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 Jun 25 18:21:34 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:35 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8" returned: 0 in 1.371s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:35 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 Jun 25 18:21:35 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:36 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8" returned: 1 in 1.025s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:21:36 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Downloaded image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c ((None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}])) to volume 8efdc544-edc8-4ffd-9452-881348c116b8 successfully. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:21:36 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Temporary image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c for user 84d2c07e09fe4e2bafb90f39a6c5cf1b is deleted. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:21:36 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Marking volume 8efdc544-edc8-4ffd-9452-881348c116b8 as bootable. {{(pid=93651) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:21:36 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Copying metadata from image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c to 8efdc544-edc8-4ffd-9452-881348c116b8. {{(pid=93651) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:21:36 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Creating volume glance metadata for volume 8efdc544-edc8-4ffd-9452-881348c116b8 backed by image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93651) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:21:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07fd286-1182-42d9-994b-c47f67b37d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8efdc544-edc8-4ffd-9452-881348c116b8', 'volume_size': 1, 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab240da4b4934e58a24c7f836ed62427', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'created_at': datetime.datetime(2026, 6, 25, 15, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 58, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c24baca-5823-458b-b803-23eceb57883a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:36 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Volume volume-8efdc544-edc8-4ffd-9452-881348c116b8 (8efdc544-edc8-4ffd-9452-881348c116b8): created successfully Jun 25 18:21:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c24baca-5823-458b-b803-23eceb57883a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Flow 'volume_create_manager' (2e0fa542-8842-4bf8-88cf-97d83da3003c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:37 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-8b94b02f-8098-4cb9-92f2-e089551feb5b tempest-TestShelveInstance-1314808157 None] Created volume successfully. Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Flow 'volume_create_manager' (05d5eff8-c829-4fa0-a8c4-63c8b891567b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6194f17f-5f83-48fa-a3c0-122539c762fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6194f17f-5f83-48fa-a3c0-122539c762fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1582571672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0690e4aa-6e90-458c-8169-65baefcf906b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d58c177dee4d7c88bf5705bbe73430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:37Z,use_quota=True,user_id='6aee12b585d24709882950d7f416a7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27795212-f079-4bc1-a7f9-7c7a4e82c88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27795212-f079-4bc1-a7f9-7c7a4e82c88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947321ff-fb8a-409b-aa5f-69cc135fa30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947321ff-fb8a-409b-aa5f-69cc135fa30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0690e4aa-6e90-458c-8169-65baefcf906b', 'volume_name': 'volume-0690e4aa-6e90-458c-8169-65baefcf906b', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986c9953-77ef-4be1-bfb1-f8f7400b9943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986c9953-77ef-4be1-bfb1-f8f7400b9943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e179512-518b-4f37-b7c5-3c074d2fcceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:37 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Volume 0690e4aa-6e90-458c-8169-65baefcf906b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0690e4aa-6e90-458c-8169-65baefcf906b', 'volume_size': 1} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1582571672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0690e4aa-6e90-458c-8169-65baefcf906b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d58c177dee4d7c88bf5705bbe73430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:37Z,use_quota=True,user_id='6aee12b585d24709882950d7f416a7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Creating volume 0690e4aa-6e90-458c-8169-65baefcf906b {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:21:37 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:21:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:37 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b 1073741824 Jun 25 18:21:37 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:38 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b 1073741824" returned: 0 in 1.011s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:38 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b Jun 25 18:21:38 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:39 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b" returned: 0 in 0.750s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:21:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:39 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e179512-518b-4f37-b7c5-3c074d2fcceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0690e4aa-6e90-458c-8169-65baefcf906b', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:39 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c997d931-d760-4e2a-95fe-187377edf46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:39 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Volume volume-0690e4aa-6e90-458c-8169-65baefcf906b (0690e4aa-6e90-458c-8169-65baefcf906b): created successfully Jun 25 18:21:39 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c997d931-d760-4e2a-95fe-187377edf46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:39 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Flow 'volume_create_manager' (05d5eff8-c829-4fa0-a8c4-63c8b891567b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:39 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-c59c6eba-287c-4bf5-b77e-e6b19c83a3da tempest-VolumesCloneTest-284414211 None] Created volume successfully. Jun 25 18:21:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:21:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:39 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:21:39 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Flow 'volume_create_manager' (a3cdaf0a-0f25-42ba-95a0-6c79cc2f0043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0c8c6e-d443-4011-844a-846fc6a68de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0c8c6e-d443-4011-844a-846fc6a68de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-18259090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08b24df-46da-42ac-8957-bd18b5f30957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d58c177dee4d7c88bf5705bbe73430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=0690e4aa-6e90-458c-8169-65baefcf906b,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:40Z,use_quota=True,user_id='6aee12b585d24709882950d7f416a7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97129c3-e09d-4663-94e3-6273af1dadba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97129c3-e09d-4663-94e3-6273af1dadba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1eb7401-6523-4637-a15f-ff4c24da1ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1eb7401-6523-4637-a15f-ff4c24da1ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f08b24df-46da-42ac-8957-bd18b5f30957', 'volume_name': 'volume-f08b24df-46da-42ac-8957-bd18b5f30957', 'volume_size': 2, 'source_volid': '0690e4aa-6e90-458c-8169-65baefcf906b', 'source_volstatus': 'available'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125b1a32-5985-4772-9457-e96a184c16c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125b1a32-5985-4772-9457-e96a184c16c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a6cb55-30d8-4d6a-9f12-8706dd033131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:40 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Volume f08b24df-46da-42ac-8957-bd18b5f30957: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f08b24df-46da-42ac-8957-bd18b5f30957', 'volume_size': 2, 'source_volid': '0690e4aa-6e90-458c-8169-65baefcf906b', 'source_volstatus': 'available'} Jun 25 18:21:40 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.027s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:40 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Cloning volume 0690e4aa-6e90-458c-8169-65baefcf906b to volume f08b24df-46da-42ac-8957-bd18b5f30957 Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 28 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Creating offline snapshot 7a08e3b2-6179-460c-b0a0-f9b429ab46e5 of volume 0690e4aa-6e90-458c-8169-65baefcf906b {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dbcc23-d55f-4ddb-b436-fd92d311a788]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:40 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b Jun 25 18:21:40 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:40 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-a87f90ee-a4d4-4e0f-804d-d59105f81c63 req-c1f1cf51-1900-43ae-8a3f-212746a70414 tempest-TestServerVolumeAttachmentScenario-296268262 None] Terminate volume connection completed successfully. Jun 25 18:21:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-a87f90ee-a4d4-4e0f-804d-d59105f81c63 req-c1f1cf51-1900-43ae-8a3f-212746a70414 tempest-TestServerVolumeAttachmentScenario-296268262 None] Deleting attachment 4f8efefb-cb1c-451e-9d3a-d9b24d4568f2. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:21:41 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b" returned: 0 in 1.126s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:41 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 1G Jun 25 18:21:41 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:42 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 1G" returned: 0 in 1.145s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0690e4aa-6e90-458c-8169-65baefcf906b -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:42 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0690e4aa-6e90-458c-8169-65baefcf906b -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 Jun 25 18:21:42 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:43 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0690e4aa-6e90-458c-8169-65baefcf906b -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5" returned: 0 in 0.941s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:43 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 is being set with open permissions: ugo+rw Jun 25 18:21:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:43 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 Jun 25 18:21:43 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:44 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5" returned: 0 in 1.274s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:45 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.info Jun 25 18:21:45 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:45 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-e6ce201d-29fc-48ce-9194-d80a29c5c2c9 req-e1db2a9b-970f-470c-93aa-8f8443a7aed4 tempest-TestServerVolumeAttachmentScenario-296268262 None] Terminate volume connection completed successfully. Jun 25 18:21:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-e6ce201d-29fc-48ce-9194-d80a29c5c2c9 req-e1db2a9b-970f-470c-93aa-8f8443a7aed4 tempest-TestServerVolumeAttachmentScenario-296268262 None] Deleting attachment 46aca288-8a93-493d-bea6-fda22f4aae1d. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:21:45 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.info" returned: 0 in 1.021s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:45 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.info is being set with open permissions: ugo+rw Jun 25 18:21:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:46 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.info Jun 25 18:21:46 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-e72b07ab-6feb-484c-87bd-8a8b4b18fdc1 req-c10073a8-cdec-494b-b7b3-be4f68fc85be tempest-TestShelveInstance-1314808157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:46 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:21:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Flow 'volume_create_manager' (210b1418-0151-4283-8e26-84cd2ca93691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe22ee09-d144-4d10-a645-5d19b6e9507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe22ee09-d144-4d10-a645-5d19b6e9507f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-697127580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f740125-1363-416b-b98a-8f95fdbc9b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe63fb1f3e94fb3944e935564bded9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8ab149af-8655-4ef2-8107-05d508a81714,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:21:47Z,use_quota=True,user_id='e782f10b680a495dacfe7172c252d9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf83c9a4-07dd-4196-8fc4-42b708c001ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf83c9a4-07dd-4196-8fc4-42b708c001ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4804312d-611c-41e1-9c6d-6620e37ec5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:47 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4804312d-611c-41e1-9c6d-6620e37ec5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f740125-1363-416b-b98a-8f95fdbc9b6e', 'volume_name': 'volume-5f740125-1363-416b-b98a-8f95fdbc9b6e', 'volume_size': 1, 'snapshot_id': '8ab149af-8655-4ef2-8107-05d508a81714'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d9ac57-6c93-47fa-a446-7e179499a4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d9ac57-6c93-47fa-a446-7e179499a4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6823c6-3a0d-4eae-ab6a-778064318a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:21:47 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Volume 5f740125-1363-416b-b98a-8f95fdbc9b6e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f740125-1363-416b-b98a-8f95fdbc9b6e', 'volume_size': 1, 'snapshot_id': '8ab149af-8655-4ef2-8107-05d508a81714'} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.info" returned: 0 in 1.151s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Acquiring lock "cinder-quobyte-f08b24df-46da-42ac-8957-bd18b5f30957" by "_copy_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Lock "cinder-quobyte-f08b24df-46da-42ac-8957-bd18b5f30957" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] snapshot: 7a08e3b2-6179-460c-b0a0-f9b429ab46e5, volume: f08b24df-46da-42ac-8957-bd18b5f30957, {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[58524f4a-7fce-459b-ac9a-3db249ca6b2a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:47 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 Jun 25 18:21:47 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:48 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5" returned: 0 in 0.960s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0690e4aa-6e90-458c-8169-65baefcf906b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:21:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] will copy from snapshot at /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:21:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Creating direct copy from snapshot {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:21:48 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[9774d125-65cf-4fce-9466-7a686dd9cf42]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:48 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b Jun 25 18:21:48 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:49 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b" returned: 0 in 1.232s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:49 devstack cinder-volume[93651]: DEBUG cinder.utils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Path /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957 not found in is_blk_device check {{(pid=93651) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:21:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:49 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957 Jun 25 18:21:49 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:55 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957" returned: 0 in 6.374s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:55 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[620db1d0-6231-4023-b956-7490ea1ddb27]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:56 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b Jun 25 18:21:56 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:57 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=22,cinder:SELECT=33,cinder:INSERT=6,cinder:DELETE=3 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:21:57 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=51,cinder:UPDATE=22,cinder:INSERT=16,cinder:DELETE=1 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:21:57 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b" returned: 0 in 1.343s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:57 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Image conversion details: src /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:21:57 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Converted 1024.00 MB image at 160.57 MB/s Jun 25 18:21:57 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957 is being set with open permissions: ugo+rw Jun 25 18:21:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:57 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957 Jun 25 18:21:57 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:58 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957" returned: 0 in 0.860s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Lock "cinder-quobyte-f08b24df-46da-42ac-8957-bd18b5f30957" released by "_copy_volume_from_snapshot" :: held 10.921s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:21:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Acquiring lock "cinder-quobyte-7a08e3b2-6179-460c-b0a0-f9b429ab46e5" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Lock "cinder-quobyte-7a08e3b2-6179-460c-b0a0-f9b429ab46e5" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Deleting offline snapshot 7a08e3b2-6179-460c-b0a0-f9b429ab46e5 of volume 0690e4aa-6e90-458c-8169-65baefcf906b {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:21:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] snapshot_file for this snap is: volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:21:58 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bef51c2-40ec-4b3b-95d0-19436a51a2fa]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:58 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 Jun 25 18:21:58 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Acquiring lock "cinder-28ab74e5-f5b2-46f6-a622-ed273cc65170-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "cinder-28ab74e5-f5b2-46f6-a622-ed273cc65170-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Acquiring lock "cinder-quobyte-28ab74e5-f5b2-46f6-a622-ed273cc65170" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:21:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "cinder-quobyte-28ab74e5-f5b2-46f6-a622-ed273cc65170" acquired by "delete_volume" :: waited 0.030s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:21:58 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aab2ff-31fd-4ec4-b67d-58eb0dadbc51]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:59 devstack sudo[109287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170 Jun 25 18:21:59 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:59 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5" returned: 0 in 1.122s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0690e4aa-6e90-458c-8169-65baefcf906b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:21:59 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c560d7-76bc-40ce-8e4c-e2e20b901712]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:21:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:59 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b Jun 25 18:21:59 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:21:59 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root Jun 25 18:21:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170" returned: 0 in 0.985s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:21:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:21:59 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170 Jun 25 18:21:59 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:00 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-28ab74e5-f5b2-46f6-a622-ed273cc65170" returned: 0 in 0.713s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "cinder-quobyte-28ab74e5-f5b2-46f6-a622-ed273cc65170" released by "delete_volume" :: held 1.763s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:00 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b" returned: 0 in 1.214s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:00 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Created reservations ['b77d8a9d-c86f-40e8-985c-aaeedd349634', '68d05137-2caa-4643-bb94-983756c2e691', 'b51e4001-3569-46ba-89be-6342625b1d60', 'ce760a2a-8d4e-4b7d-b57d-e1a7738f98ad'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:00 devstack sudo[109316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 Jun 25 18:22:00 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:00 devstack sudo[109318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:22:00 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Acquiring lock "cinder-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "cinder-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Acquiring lock "cinder-quobyte-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "cinder-quobyte-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c" acquired by "delete_volume" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:01 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[8816011f-3ed0-4026-b5aa-e330cdc9336c]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:01 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c Jun 25 18:22:01 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:01 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.011s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:01 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:01 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5" returned: 0 in 1.148s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:01 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Deleted volume successfully. Jun 25 18:22:01 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5 Jun 25 18:22:01 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5493ab72-325f-4681-a055-6e9f5171aa7a tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "cinder-28ab74e5-f5b2-46f6-a622-ed273cc65170-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:02 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c" returned: 0 in 1.069s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:02 devstack sudo[109335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c Jun 25 18:22:02 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:02 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b.7a08e3b2-6179-460c-b0a0-f9b429ab46e5" returned: 0 in 0.777s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Lock "cinder-quobyte-7a08e3b2-6179-460c-b0a0-f9b429ab46e5" released by "_delete_snapshot" :: held 4.406s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.322s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-e72b07ab-6feb-484c-87bd-8a8b4b18fdc1 req-c10073a8-cdec-494b-b7b3-be4f68fc85be tempest-TestShelveInstance-1314808157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.864s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a6cb55-30d8-4d6a-9f12-8706dd033131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f08b24df-46da-42ac-8957-bd18b5f30957', 'volume_size': 2, 'source_volid': '0690e4aa-6e90-458c-8169-65baefcf906b', 'source_volstatus': 'available'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14797828-5024-43c9-9bc7-8cde0ab4fa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:02 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4878e7e5-15cb-4add-9e01-02413017f1d6]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-e72b07ab-6feb-484c-87bd-8a8b4b18fdc1 req-c10073a8-cdec-494b-b7b3-be4f68fc85be tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:02 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Volume volume-f08b24df-46da-42ac-8957-bd18b5f30957 (f08b24df-46da-42ac-8957-bd18b5f30957): created successfully Jun 25 18:22:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14797828-5024-43c9-9bc7-8cde0ab4fa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Flow 'volume_create_manager' (a3cdaf0a-0f25-42ba-95a0-6c79cc2f0043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:02 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4deb9f5c-a3ae-470f-9f5d-cea617af292e tempest-VolumesCloneTest-284414211 None] Created volume successfully. Jun 25 18:22:02 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 Jun 25 18:22:02 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:03 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c" returned: 0 in 0.814s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "cinder-quobyte-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c" released by "delete_volume" :: held 1.940s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:03 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Created reservations ['dbac70f2-908b-4a44-8e60-d7a744b43e3e', '48d37f45-41cd-4f0d-b1f8-17f7492b8ae6', '04a04797-13ac-414c-90ca-2b9a8ade62db', 'c82883db-e911-4d40-b831-6c4641ad0bb8'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:03 devstack sudo[109341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:22:03 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Acquiring lock "cinder-f08b24df-46da-42ac-8957-bd18b5f30957-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Lock "cinder-f08b24df-46da-42ac-8957-bd18b5f30957-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:03 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-e72b07ab-6feb-484c-87bd-8a8b4b18fdc1 req-c10073a8-cdec-494b-b7b3-be4f68fc85be tempest-TestShelveInstance-1314808157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8" returned: 0 in 1.252s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-e72b07ab-6feb-484c-87bd-8a8b4b18fdc1 req-c10073a8-cdec-494b-b7b3-be4f68fc85be tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Acquiring lock "cinder-quobyte-f08b24df-46da-42ac-8957-bd18b5f30957" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Lock "cinder-quobyte-f08b24df-46da-42ac-8957-bd18b5f30957" acquired by "delete_volume" :: waited 0.028s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:04 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4e5cad-b4d7-4af9-8262-5c6112812b66]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:04 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.029s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:04 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Deleted volume successfully. Jun 25 18:22:04 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 Jun 25 18:22:04 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:04 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957 Jun 25 18:22:04 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ac9b8e31-2f7a-40c4-a156-918940c0ace7 tempest-TestServerVolumeAttachmentScenario-296268262 None] Lock "cinder-d33f4c7d-59ea-4a3f-8c0a-7ee86de88b1c-delete_volume" released by "delete_volume" :: held 3.321s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:05 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957" returned: 0 in 1.567s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:05 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957 Jun 25 18:22:05 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:05 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-e72b07ab-6feb-484c-87bd-8a8b4b18fdc1 req-c10073a8-cdec-494b-b7b3-be4f68fc85be tempest-TestShelveInstance-1314808157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8" returned: 1 in 1.795s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-e72b07ab-6feb-484c-87bd-8a8b4b18fdc1 req-c10073a8-cdec-494b-b7b3-be4f68fc85be tempest-TestShelveInstance-1314808157 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-e72b07ab-6feb-484c-87bd-8a8b4b18fdc1 req-c10073a8-cdec-494b-b7b3-be4f68fc85be tempest-TestShelveInstance-1314808157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.107s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 18.574s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Acquiring lock "cinder-quobyte-8ab149af-8655-4ef2-8107-05d508a81714-5f740125-1363-416b-b98a-8f95fdbc9b6e" by "_create_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Lock "cinder-quobyte-8ab149af-8655-4ef2-8107-05d508a81714-5f740125-1363-416b-b98a-8f95fdbc9b6e" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Creating volume 5f740125-1363-416b-b98a-8f95fdbc9b6e from snapshot 8ab149af-8655-4ef2-8107-05d508a81714 {{(pid=93651) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Acquiring lock "cinder-quobyte-5f740125-1363-416b-b98a-8f95fdbc9b6e" by "_copy_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-e72b07ab-6feb-484c-87bd-8a8b4b18fdc1 req-c10073a8-cdec-494b-b7b3-be4f68fc85be tempest-TestShelveInstance-1314808157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-8efdc544-edc8-4ffd-9452-881348c116b8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01ccad0a-13c7-4a31-9bf9-c785f443aa8b', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Lock "cinder-quobyte-5f740125-1363-416b-b98a-8f95fdbc9b6e" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] snapshot: 8ab149af-8655-4ef2-8107-05d508a81714, volume: 5f740125-1363-416b-b98a-8f95fdbc9b6e, {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:22:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:06 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[d801cc5c-fc39-4172-adcb-24a4c740fd2a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:06 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-e72b07ab-6feb-484c-87bd-8a8b4b18fdc1 req-c10073a8-cdec-494b-b7b3-be4f68fc85be tempest-TestShelveInstance-1314808157 None] attachment_update completed successfully. Jun 25 18:22:06 devstack sudo[109411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 Jun 25 18:22:06 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:06 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f08b24df-46da-42ac-8957-bd18b5f30957" returned: 0 in 1.250s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Lock "cinder-quobyte-f08b24df-46da-42ac-8957-bd18b5f30957" released by "delete_volume" :: held 2.912s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:07 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Created reservations ['426c3179-bec4-452c-92d3-c015ac7bd4b0', '1fb9a5d0-11a9-4e38-81b2-c9c0a639c031', '1692e397-200e-4360-aca6-f294d159935b', '12e66170-9b65-4a07-90d3-0fd83a002a7b'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:07 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:22:07 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Acquiring lock "cinder-0690e4aa-6e90-458c-8169-65baefcf906b-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Lock "cinder-0690e4aa-6e90-458c-8169-65baefcf906b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Acquiring lock "cinder-quobyte-0690e4aa-6e90-458c-8169-65baefcf906b" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Lock "cinder-quobyte-0690e4aa-6e90-458c-8169-65baefcf906b" acquired by "delete_volume" :: waited 0.045s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:07 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e131739-12e7-40f9-9515-beeca8ccf65c]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:08 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714" returned: 0 in 2.155s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:22:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] will copy from snapshot at /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:22:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Creating direct copy from snapshot {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:22:08 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b Jun 25 18:22:08 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:08 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dff3fa-1705-49ed-90e1-f8f6a6f1736c]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:08 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d Jun 25 18:22:08 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:09 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b" returned: 0 in 1.744s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:09 devstack sudo[109499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b Jun 25 18:22:09 devstack sudo[109499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:09 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 2.594s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:09 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:09 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Deleted volume successfully. Jun 25 18:22:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c73a3bee-88a3-4b04-b2f7-141b8a8143a8 tempest-VolumesCloneTest-284414211 None] Lock "cinder-f08b24df-46da-42ac-8957-bd18b5f30957-delete_volume" released by "delete_volume" :: held 6.079s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:10 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d" returned: 0 in 1.778s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:10 devstack cinder-volume[93651]: DEBUG cinder.utils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Path /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e not found in is_blk_device check {{(pid=93651) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:22:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:10 devstack sudo[109504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e Jun 25 18:22:10 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:11 devstack sudo[109499]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0690e4aa-6e90-458c-8169-65baefcf906b" returned: 0 in 1.432s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:11 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Lock "cinder-quobyte-0690e4aa-6e90-458c-8169-65baefcf906b" released by "delete_volume" :: held 3.328s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:11 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Created reservations ['82a6f3cc-9d3b-40d6-9875-dff9d6607223', '4e22685d-ae1e-4909-8c1b-b4a2eac088af', '3311b3c2-b4ce-4814-b865-42459d16a9ba', '52483617-e815-4636-a237-7d4838396760'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:11 devstack sudo[109514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:22:11 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:13 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 2.339s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:13 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:13 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Deleted volume successfully. Jun 25 18:22:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-d1454b23-af48-4619-900c-4e07683ad8a4 tempest-VolumesCloneTest-284414211 None] Lock "cinder-0690e4aa-6e90-458c-8169-65baefcf906b-delete_volume" released by "delete_volume" :: held 6.337s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:21 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=40,cinder:SELECT=22,cinder:INSERT=9,cinder:DELETE=2 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:22:21 devstack sudo[109504]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e" returned: 0 in 11.888s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:21 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[00de0efb-7070-4cc8-82f2-50ccdc5b0488]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:22 devstack sudo[109930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d Jun 25 18:22:22 devstack sudo[109930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:23 devstack sudo[109930]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d" returned: 0 in 1.952s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:23 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Image conversion details: src /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d, size 1024.00 MB, duration 11.89 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:22:23 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Converted 1024.00 MB image at 86.13 MB/s Jun 25 18:22:23 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e is being set with open permissions: ugo+rw Jun 25 18:22:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:24 devstack sudo[109936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e Jun 25 18:22:24 devstack sudo[109936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e" returned: 0 in 1.322s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Lock "cinder-quobyte-5f740125-1363-416b-b98a-8f95fdbc9b6e" released by "_copy_volume_from_snapshot" :: held 19.377s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Lock "cinder-quobyte-8ab149af-8655-4ef2-8107-05d508a81714-5f740125-1363-416b-b98a-8f95fdbc9b6e" released by "_create_volume_from_snapshot" :: held 19.462s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 19.502s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:25 devstack sudo[109936]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6823c6-3a0d-4eae-ab6a-778064318a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f740125-1363-416b-b98a-8f95fdbc9b6e', 'volume_size': 1, 'snapshot_id': '8ab149af-8655-4ef2-8107-05d508a81714'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a60070-3294-4ce5-85a6-185b049f7a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:25 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Volume volume-5f740125-1363-416b-b98a-8f95fdbc9b6e (5f740125-1363-416b-b98a-8f95fdbc9b6e): created successfully Jun 25 18:22:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a60070-3294-4ce5-85a6-185b049f7a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Flow 'volume_create_manager' (210b1418-0151-4283-8e26-84cd2ca93691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:25 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-c33913fe-cbb6-478e-8f87-be7926ad221c tempest-TestStampPattern-177067603 None] Created volume successfully. Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Flow 'volume_create_manager' (afa00187-32f6-4c6f-a053-635b15d13339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0971f817-7b84-4ff5-8e50-01716830b92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0971f817-7b84-4ff5-8e50-01716830b92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1598112171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6527fa9f-51cf-4fcf-ad9c-497c1c74327f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e55878fcf9964ecab5504e35fe766393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:27Z,use_quota=True,user_id='d9a0a4c582b6445dbd0225cc1fe2158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36317086-4d8a-4a78-a82f-2553edc7a05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36317086-4d8a-4a78-a82f-2553edc7a05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc4bd54-1f83-4eae-ac02-9034b25da4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc4bd54-1f83-4eae-ac02-9034b25da4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6527fa9f-51cf-4fcf-ad9c-497c1c74327f', 'volume_name': 'volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039a8625-5b02-4eed-84e5-0fd06abfe172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039a8625-5b02-4eed-84e5-0fd06abfe172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b472c7-fc3e-453f-b5cb-58f11f3c94ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:26 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Volume 6527fa9f-51cf-4fcf-ad9c-497c1c74327f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f', 'volume_size': 1} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1598112171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6527fa9f-51cf-4fcf-ad9c-497c1c74327f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e55878fcf9964ecab5504e35fe766393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:27Z,use_quota=True,user_id='d9a0a4c582b6445dbd0225cc1fe2158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Creating volume 6527fa9f-51cf-4fcf-ad9c-497c1c74327f {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:27 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:22:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:27 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f 1073741824 Jun 25 18:22:27 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:28 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f 1073741824" returned: 0 in 1.425s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:28 devstack sudo[109985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f Jun 25 18:22:28 devstack sudo[109985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:30 devstack sudo[109985]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f" returned: 0 in 1.979s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] <== create_volume: return (3460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.462s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b472c7-fc3e-453f-b5cb-58f11f3c94ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c42f77-7ba9-44a5-aaba-1cf00e88de88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:30 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Volume volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f (6527fa9f-51cf-4fcf-ad9c-497c1c74327f): created successfully Jun 25 18:22:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c42f77-7ba9-44a5-aaba-1cf00e88de88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Flow 'volume_create_manager' (afa00187-32f6-4c6f-a053-635b15d13339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:30 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-08c2caef-649a-4935-a2aa-85fcd950fdc9 tempest-VolumesGetTest-1914453881 None] Created volume successfully. Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Flow 'volume_create_manager' (b891d616-0e4c-44c7-80e6-b6f4e35afb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68039a6d-3c23-40b3-a59d-4f8e2d6ebe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68039a6d-3c23-40b3-a59d-4f8e2d6ebe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1471474917',display_name='tempest-VolumesGetTest-Volume-634838299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db801467-35b6-4b78-940c-6e3d694e81c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55878fcf9964ecab5504e35fe766393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:32Z,use_quota=True,user_id='d9a0a4c582b6445dbd0225cc1fe2158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eeaa838-444d-42a2-aeb3-f326b2917aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eeaa838-444d-42a2-aeb3-f326b2917aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6937db4b-386c-40a8-93b9-809187a5eced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6937db4b-386c-40a8-93b9-809187a5eced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db801467-35b6-4b78-940c-6e3d694e81c0', 'volume_name': 'volume-db801467-35b6-4b78-940c-6e3d694e81c0', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826f6ca6-95ed-41ff-8587-bdd4e2887f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826f6ca6-95ed-41ff-8587-bdd4e2887f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d21274d-4da8-4ae5-9d79-e5ba986144a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:32 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Volume db801467-35b6-4b78-940c-6e3d694e81c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db801467-35b6-4b78-940c-6e3d694e81c0', 'volume_size': 1} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1471474917',display_name='tempest-VolumesGetTest-Volume-634838299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db801467-35b6-4b78-940c-6e3d694e81c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55878fcf9964ecab5504e35fe766393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:32Z,use_quota=True,user_id='d9a0a4c582b6445dbd0225cc1fe2158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Creating volume db801467-35b6-4b78-940c-6e3d694e81c0 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:32 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:22:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db801467-35b6-4b78-940c-6e3d694e81c0 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:32 devstack sudo[110028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db801467-35b6-4b78-940c-6e3d694e81c0 1073741824 Jun 25 18:22:32 devstack sudo[110028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:34 devstack sudo[110028]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db801467-35b6-4b78-940c-6e3d694e81c0 1073741824" returned: 0 in 1.399s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db801467-35b6-4b78-940c-6e3d694e81c0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:34 devstack sudo[110035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db801467-35b6-4b78-940c-6e3d694e81c0 Jun 25 18:22:34 devstack sudo[110035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:35 devstack sudo[110035]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db801467-35b6-4b78-940c-6e3d694e81c0" returned: 0 in 0.950s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] <== create_volume: return (2428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.431s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d21274d-4da8-4ae5-9d79-e5ba986144a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db801467-35b6-4b78-940c-6e3d694e81c0', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a86d649-57f2-492c-9515-ec55b0b6fe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:35 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Volume volume-db801467-35b6-4b78-940c-6e3d694e81c0 (db801467-35b6-4b78-940c-6e3d694e81c0): created successfully Jun 25 18:22:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a86d649-57f2-492c-9515-ec55b0b6fe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Flow 'volume_create_manager' (b891d616-0e4c-44c7-80e6-b6f4e35afb04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:35 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-75b03a55-073c-40e9-a7a3-34f17983163b tempest-VolumesGetTest-1914453881 None] Created volume successfully. Jun 25 18:22:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-db801467-35b6-4b78-940c-6e3d694e81c0-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Lock "cinder-db801467-35b6-4b78-940c-6e3d694e81c0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-quobyte-db801467-35b6-4b78-940c-6e3d694e81c0" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-db801467-35b6-4b78-940c-6e3d694e81c0" acquired by "delete_volume" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:35 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b3850c-9591-4144-980a-bb6fed4c9623]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db801467-35b6-4b78-940c-6e3d694e81c0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:36 devstack sudo[110038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db801467-35b6-4b78-940c-6e3d694e81c0 Jun 25 18:22:36 devstack sudo[110038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:36 devstack sudo[110038]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db801467-35b6-4b78-940c-6e3d694e81c0" returned: 0 in 0.918s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db801467-35b6-4b78-940c-6e3d694e81c0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:36 devstack sudo[110051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db801467-35b6-4b78-940c-6e3d694e81c0 Jun 25 18:22:36 devstack sudo[110051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:37 devstack sudo[110051]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-db801467-35b6-4b78-940c-6e3d694e81c0" returned: 0 in 0.763s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-db801467-35b6-4b78-940c-6e3d694e81c0" released by "delete_volume" :: held 1.742s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:37 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Created reservations ['c9b31b2c-07fa-41c7-b1a9-01d1cc971c06', 'e8ac84d0-01c4-47b4-9330-4b65b4b605cf', 'f0c5b978-4096-49e7-8503-fde9a5d15fbf', '4ae30029-b629-4fde-86bc-132d55dfc6ef'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:37 devstack sudo[110057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:22:37 devstack sudo[110057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-6527fa9f-51cf-4fcf-ad9c-497c1c74327f-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Lock "cinder-6527fa9f-51cf-4fcf-ad9c-497c1c74327f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-quobyte-6527fa9f-51cf-4fcf-ad9c-497c1c74327f" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-6527fa9f-51cf-4fcf-ad9c-497c1c74327f" acquired by "delete_volume" :: waited 0.016s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:38 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0111694-7c86-4f15-b9bb-29e4e5071a4e]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:38 devstack sudo[110125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f Jun 25 18:22:38 devstack sudo[110125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:38 devstack sudo[110057]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.007s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:38 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:38 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Deleted volume successfully. Jun 25 18:22:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1d4e03cf-f315-4426-a258-75df3147bfc7 tempest-VolumesGetTest-1914453881 None] Lock "cinder-db801467-35b6-4b78-940c-6e3d694e81c0-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:22:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:39 devstack sudo[110130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:22:39 devstack sudo[110130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:39 devstack sudo[110125]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f" returned: 0 in 1.227s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:39 devstack sudo[110136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f Jun 25 18:22:39 devstack sudo[110136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-5926df4e-6c40-4f54-80d5-76528496e1a0 req-278b5379-00bd-4ce9-a30d-dc51972b805a tempest-TestStampPattern-177067603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-5926df4e-6c40-4f54-80d5-76528496e1a0 req-278b5379-00bd-4ce9-a30d-dc51972b805a tempest-TestStampPattern-177067603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:39 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1371f87-4ae3-4ba1-bb88-651806102f20]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-5926df4e-6c40-4f54-80d5-76528496e1a0 req-278b5379-00bd-4ce9-a30d-dc51972b805a tempest-TestStampPattern-177067603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:39 devstack sudo[110144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e Jun 25 18:22:39 devstack sudo[110144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:40 devstack sudo[110130]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.896s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 28 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:22:40 devstack sudo[110136]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6527fa9f-51cf-4fcf-ad9c-497c1c74327f" returned: 0 in 0.801s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-6527fa9f-51cf-4fcf-ad9c-497c1c74327f" released by "delete_volume" :: held 2.097s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Created reservations ['aeaddbb9-6a22-46ff-a6ab-cc9a7fdeeb92', '328ccb16-7ac2-43fe-b67b-d593b26c5489', '32735ec2-6279-4d10-9113-aa240993d2eb', '4d25bf57-4414-414c-8ac7-c4cab1ef3d01'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:40 devstack sudo[110148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:22:40 devstack sudo[110148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Flow 'volume_create_manager' (4d74af58-0b47-45dc-bfb9-cddd1f6fe1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebc7aae-a1ee-495c-977c-cde7765ab394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:40 devstack sudo[110144]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-5926df4e-6c40-4f54-80d5-76528496e1a0 req-278b5379-00bd-4ce9-a30d-dc51972b805a tempest-TestStampPattern-177067603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e" returned: 0 in 0.976s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-5926df4e-6c40-4f54-80d5-76528496e1a0 req-278b5379-00bd-4ce9-a30d-dc51972b805a tempest-TestStampPattern-177067603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebc7aae-a1ee-495c-977c-cde7765ab394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=508e4602-b54a-4cc4-92dd-29db89b4e2f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5f6ba5220224e308dfc79d5d3a2884d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:41Z,use_quota=True,user_id='109a99b60faa4602b50992a26bb61b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad384960-a2aa-4470-b98e-e353e5998283),volume_type_id=ad384960-a2aa-4470-b98e-e353e5998283)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf39c106-0a5a-4965-ada2-6a29efd748cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf39c106-0a5a-4965-ada2-6a29efd748cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e84e8b4-1cb1-4d08-90f6-3295b7dd1cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.image.glance [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Creating Keystone auth plugin from conf {{(pid=93651) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:22:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-5926df4e-6c40-4f54-80d5-76528496e1a0 req-278b5379-00bd-4ce9-a30d-dc51972b805a tempest-TestStampPattern-177067603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-5f740125-1363-416b-b98a-8f95fdbc9b6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8ff160c-1057-47f0-8b4e-372faaa52732', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:22:41 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-5926df4e-6c40-4f54-80d5-76528496e1a0 req-278b5379-00bd-4ce9-a30d-dc51972b805a tempest-TestStampPattern-177067603 None] attachment_update completed successfully. Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e84e8b4-1cb1-4d08-90f6-3295b7dd1cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '508e4602-b54a-4cc4-92dd-29db89b4e2f2', 'volume_name': 'volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2', 'volume_size': 1, 'image_id': '47ad7ca9-9365-4fc9-8cd7-1eaff40f109d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47ad7ca9-9365-4fc9-8cd7-1eaff40f109d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a18ff38e8752d06b3f9780e899195848', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c5f6ba5220224e308dfc79d5d3a2884d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fb8c0fc8795050e16ca8e86b14a5e556fe4c187f8e6900e3556513b10b6632fbe1de179f4b1b91deda97042a6a686fbdb5553b0dc895b25811aa3a2a82f3fff', 'id': '47ad7ca9-9365-4fc9-8cd7-1eaff40f109d', 'created_at': datetime.datetime(2026, 6, 25, 16, 22, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 22, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47ad7ca9-9365-4fc9-8cd7-1eaff40f109d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c12bd76-51e5-4c8a-96e6-6421a8c602b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c12bd76-51e5-4c8a-96e6-6421a8c602b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04ac79f-c61e-4306-84dd-32e168518c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:41 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Volume 508e4602-b54a-4cc4-92dd-29db89b4e2f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2', 'volume_size': 1, 'image_id': '47ad7ca9-9365-4fc9-8cd7-1eaff40f109d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47ad7ca9-9365-4fc9-8cd7-1eaff40f109d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a18ff38e8752d06b3f9780e899195848', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c5f6ba5220224e308dfc79d5d3a2884d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fb8c0fc8795050e16ca8e86b14a5e556fe4c187f8e6900e3556513b10b6632fbe1de179f4b1b91deda97042a6a686fbdb5553b0dc895b25811aa3a2a82f3fff', 'id': '47ad7ca9-9365-4fc9-8cd7-1eaff40f109d', 'created_at': datetime.datetime(2026, 6, 25, 16, 22, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 22, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47ad7ca9-9365-4fc9-8cd7-1eaff40f109d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Trying to clone 508e4602-b54a-4cc4-92dd-29db89b4e2f2 from image 47ad7ca9-9365-4fc9-8cd7-1eaff40f109d at location (None, [{'url': 'file:///opt/stack/data/glance/images/47ad7ca9-9365-4fc9-8cd7-1eaff40f109d', 'metadata': {}}]). {{(pid=93651) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:22:41 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Image download 0.00 MB at 0.00 MB/s Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21e46a6-39c6-4a16-842a-ba556d1716c7]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Flow 'volume_create_manager' (943c9cdf-9259-465b-9ef8-df37d54d192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7cd7bb0-195f-4417-9623-aa14a8dd1b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:41 devstack sudo[110148]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.894s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7cd7bb0-195f-4417-9623-aa14a8dd1b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1624927104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760c61a0-cf16-426a-b559-3c1aef74ddb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55878fcf9964ecab5504e35fe766393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:41Z,use_quota=True,user_id='d9a0a4c582b6445dbd0225cc1fe2158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34f6fa8-8037-498a-901b-d3d3ed4807b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34f6fa8-8037-498a-901b-d3d3ed4807b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:41 devstack sudo[110154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD Jun 25 18:22:41 devstack sudo[110154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41053879-c247-4abf-be4f-3c398fc06fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41053879-c247-4abf-be4f-3c398fc06fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760c61a0-cf16-426a-b559-3c1aef74ddb9', 'volume_name': 'volume-760c61a0-cf16-426a-b559-3c1aef74ddb9', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0acada-d4ea-40b8-a884-5bea920133a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0acada-d4ea-40b8-a884-5bea920133a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efb2331-abc9-436e-81ef-618e969eaea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:41 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Volume 760c61a0-cf16-426a-b559-3c1aef74ddb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760c61a0-cf16-426a-b559-3c1aef74ddb9', 'volume_size': 1} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1624927104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760c61a0-cf16-426a-b559-3c1aef74ddb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55878fcf9964ecab5504e35fe766393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:41Z,use_quota=True,user_id='d9a0a4c582b6445dbd0225cc1fe2158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Creating volume 760c61a0-cf16-426a-b559-3c1aef74ddb9 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:41 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:41 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Deleted volume successfully. Jun 25 18:22:41 devstack sudo[110156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 1073741824 Jun 25 18:22:41 devstack sudo[110156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2a799cb5-51eb-49b0-b9fd-1fd0053e1a7f tempest-VolumesGetTest-1914453881 None] Lock "cinder-6527fa9f-51cf-4fcf-ad9c-497c1c74327f-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:22:42 devstack sudo[110154]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD" returned: 0 in 0.897s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:42 devstack sudo[110168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD Jun 25 18:22:42 devstack sudo[110168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:42 devstack sudo[110156]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 1073741824" returned: 0 in 1.021s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:42 devstack sudo[110171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 Jun 25 18:22:42 devstack sudo[110171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:43 devstack sudo[110168]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD" returned: 1 in 0.839s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:22:43 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Temporary image 47ad7ca9-9365-4fc9-8cd7-1eaff40f109d is fetched for user 109a99b60faa4602b50992a26bb61b58. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:22:43 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[a482931c-f881-4255-bab8-8911645e9489]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:43 devstack sudo[110176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD Jun 25 18:22:43 devstack sudo[110176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:43 devstack sudo[110171]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9" returned: 0 in 0.750s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efb2331-abc9-436e-81ef-618e969eaea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760c61a0-cf16-426a-b559-3c1aef74ddb9', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ed5006-194a-4382-94f6-48bb6c39cf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:43 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Volume volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 (760c61a0-cf16-426a-b559-3c1aef74ddb9): created successfully Jun 25 18:22:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ed5006-194a-4382-94f6-48bb6c39cf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Flow 'volume_create_manager' (943c9cdf-9259-465b-9ef8-df37d54d192b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:43 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4c60c6a6-1b8e-4aac-b472-19f2f331bd8d tempest-VolumesGetTest-1914453881 None] Created volume successfully. Jun 25 18:22:44 devstack sudo[110176]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD" returned: 0 in 0.819s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:44 devstack sudo[110181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD Jun 25 18:22:44 devstack sudo[110181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:44 devstack sudo[110181]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD" returned: 1 in 0.792s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=508e4602-b54a-4cc4-92dd-29db89b4e2f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5f6ba5220224e308dfc79d5d3a2884d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:41Z,use_quota=True,user_id='109a99b60faa4602b50992a26bb61b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad384960-a2aa-4470-b98e-e353e5998283),volume_type_id=ad384960-a2aa-4470-b98e-e353e5998283)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Creating volume 508e4602-b54a-4cc4-92dd-29db89b4e2f2 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:22:44 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:22:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:44 devstack sudo[110186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 1073741824 Jun 25 18:22:44 devstack sudo[110186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:45 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:22:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Flow 'volume_create_manager' (0a4b8156-5d49-40f2-950e-51f0e4ed6df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c4b406-590e-4edc-84bc-c74e506c512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c4b406-590e-4edc-84bc-c74e506c512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-194962676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2766bcc7-e05d-4c5f-b05f-d2d1271cec46,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e55878fcf9964ecab5504e35fe766393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=760c61a0-cf16-426a-b559-3c1aef74ddb9,status='creating',terminated_at=None,updated_at=2026-06-25T16:22:45Z,use_quota=True,user_id='d9a0a4c582b6445dbd0225cc1fe2158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d581947b-3719-4bde-811a-e64067a03b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d581947b-3719-4bde-811a-e64067a03b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf7901d-5d59-48b1-b2cf-bf4ebb89b673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf7901d-5d59-48b1-b2cf-bf4ebb89b673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2766bcc7-e05d-4c5f-b05f-d2d1271cec46', 'volume_name': 'volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46', 'volume_size': 1, 'source_volid': '760c61a0-cf16-426a-b559-3c1aef74ddb9', 'source_volstatus': 'available'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10135440-07aa-4f90-910b-d1bc72278ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10135440-07aa-4f90-910b-d1bc72278ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6f136b-a33d-456e-97ea-afc87d31b17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:45 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Volume 2766bcc7-e05d-4c5f-b05f-d2d1271cec46: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46', 'volume_size': 1, 'source_volid': '760c61a0-cf16-426a-b559-3c1aef74ddb9', 'source_volstatus': 'available'} Jun 25 18:22:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:45 devstack sudo[110186]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 1073741824" returned: 0 in 1.049s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:45 devstack sudo[110209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 Jun 25 18:22:45 devstack sudo[110209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:46 devstack sudo[110209]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2" returned: 0 in 0.774s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:22:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.371s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:46 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Cloning volume 760c61a0-cf16-426a-b559-3c1aef74ddb9 to volume 2766bcc7-e05d-4c5f-b05f-d2d1271cec46 Jun 25 18:22:46 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Attempting download of 47ad7ca9-9365-4fc9-8cd7-1eaff40f109d ((None, [{'url': 'file:///opt/stack/data/glance/images/47ad7ca9-9365-4fc9-8cd7-1eaff40f109d', 'metadata': {}}])) to volume 508e4602-b54a-4cc4-92dd-29db89b4e2f2. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:22:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Creating offline snapshot c7ff7ebf-f964-4dc1-9278-8ba889eeb20c of volume 760c61a0-cf16-426a-b559-3c1aef74ddb9 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:22:46 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[9045b56e-21d6-49af-90c8-f1d2fd967f46]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:46 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e076bc-e255-4ae5-a427-a41c8efd305c]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_18n467o6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:46 devstack sudo[110218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 Jun 25 18:22:46 devstack sudo[110218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:46 devstack sudo[110219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_18n467o6 Jun 25 18:22:46 devstack sudo[110219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:47 devstack sudo[110219]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:47 devstack sudo[110218]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_18n467o6" returned: 0 in 0.859s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_18n467o6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9" returned: 0 in 0.914s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:47 devstack sudo[110231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c 1G Jun 25 18:22:47 devstack sudo[110231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:47 devstack sudo[110228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_18n467o6 Jun 25 18:22:47 devstack sudo[110228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:48 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-7cbf2e4d-bdd0-4da1-96e3-11d74691dd10 req-8858f95b-70ac-471c-b6ef-b855795ca087 tempest-TestStampPattern-177067603 None] Terminate volume connection completed successfully. Jun 25 18:22:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-7cbf2e4d-bdd0-4da1-96e3-11d74691dd10 req-8858f95b-70ac-471c-b6ef-b855795ca087 tempest-TestStampPattern-177067603 None] Deleting attachment f8ff160c-1057-47f0-8b4e-372faaa52732. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:22:48 devstack sudo[110228]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_18n467o6" returned: 1 in 0.885s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_18n467o6' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:22:48 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d30cef-e5ae-489a-b281-47d26bd8c7e5]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:48 devstack sudo[110243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD Jun 25 18:22:48 devstack sudo[110243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:48 devstack sudo[110231]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c 1G" returned: 0 in 1.062s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:48 devstack sudo[110245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c Jun 25 18:22:48 devstack sudo[110245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:49 devstack sudo[110243]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD" returned: 0 in 0.905s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:49 devstack sudo[110249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD Jun 25 18:22:49 devstack sudo[110249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:49 devstack sudo[110245]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c" returned: 0 in 0.981s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:49 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c is being set with open permissions: ugo+rw Jun 25 18:22:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:49 devstack sudo[110254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c Jun 25 18:22:49 devstack sudo[110254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:50 devstack sudo[110249]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD" returned: 1 in 0.910s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:22:50 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] 47ad7ca9-9365-4fc9-8cd7-1eaff40f109d was raw, converting to raw {{(pid=93651) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:22:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:50 devstack sudo[110260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 Jun 25 18:22:50 devstack sudo[110260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:50 devstack sudo[110254]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c" returned: 0 in 1.087s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:50 devstack sudo[110270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.info Jun 25 18:22:50 devstack sudo[110270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:51 devstack sudo[110260]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2" returned: 0 in 1.295s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:51 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_47ad7ca9-9365-4fc9-8cd7-1eaff40f109d_zcsc80ifdevstack@QuobyteHD, size 0.00 MB, duration 1.30 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:22:51 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Converted 0.00 MB image at 0.00 MB/s Jun 25 18:22:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:51 devstack sudo[110279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 1G Jun 25 18:22:51 devstack sudo[110279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:51 devstack sudo[110270]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.info" returned: 0 in 1.095s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:52 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.info is being set with open permissions: ugo+rw Jun 25 18:22:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:52 devstack sudo[110282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.info Jun 25 18:22:52 devstack sudo[110282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:52 devstack sudo[110279]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 1G" returned: 0 in 1.083s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:52 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[093a9c95-dc36-4ab3-a6f0-dc41062723b2]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:53 devstack sudo[110282]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.info" returned: 0 in 1.010s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-quobyte-2766bcc7-e05d-4c5f-b05f-d2d1271cec46" by "_copy_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-2766bcc7-e05d-4c5f-b05f-d2d1271cec46" acquired by "_copy_volume_from_snapshot" :: waited 0.063s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] snapshot: c7ff7ebf-f964-4dc1-9278-8ba889eeb20c, volume: 2766bcc7-e05d-4c5f-b05f-d2d1271cec46, {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:22:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:22:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:22:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:22:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:22:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:22:53 devstack sudo[110327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 Jun 25 18:22:53 devstack sudo[110327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:53 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a799c7-80bc-49cf-bd64-f5c1c114d250]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:53 devstack sudo[110367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c Jun 25 18:22:53 devstack sudo[110367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:54 devstack sudo[110327]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2" returned: 0 in 1.423s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:54 devstack sudo[110367]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c" returned: 0 in 1.185s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-760c61a0-cf16-426a-b559-3c1aef74ddb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:22:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] will copy from snapshot at /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:22:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Creating direct copy from snapshot {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:22:54 devstack sudo[110396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 Jun 25 18:22:54 devstack sudo[110396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:54 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe13149-b37a-4f59-9e51-ac80f2621b37]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:54 devstack sudo[110399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 Jun 25 18:22:54 devstack sudo[110399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:55 devstack sudo[110396]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2" returned: 1 in 1.226s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:22:55 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Downloaded image 47ad7ca9-9365-4fc9-8cd7-1eaff40f109d ((None, [{'url': 'file:///opt/stack/data/glance/images/47ad7ca9-9365-4fc9-8cd7-1eaff40f109d', 'metadata': {}}])) to volume 508e4602-b54a-4cc4-92dd-29db89b4e2f2 successfully. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:22:55 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Temporary image 47ad7ca9-9365-4fc9-8cd7-1eaff40f109d for user 109a99b60faa4602b50992a26bb61b58 is deleted. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:22:55 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Marking volume 508e4602-b54a-4cc4-92dd-29db89b4e2f2 as bootable. {{(pid=93651) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:22:55 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Copying metadata from image 47ad7ca9-9365-4fc9-8cd7-1eaff40f109d to 508e4602-b54a-4cc4-92dd-29db89b4e2f2. {{(pid=93651) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:22:55 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Creating volume glance metadata for volume 508e4602-b54a-4cc4-92dd-29db89b4e2f2 backed by image 47ad7ca9-9365-4fc9-8cd7-1eaff40f109d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '47ad7ca9-9365-4fc9-8cd7-1eaff40f109d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a18ff38e8752d06b3f9780e899195848', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93651) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:22:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04ac79f-c61e-4306-84dd-32e168518c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2', 'volume_size': 1, 'image_id': '47ad7ca9-9365-4fc9-8cd7-1eaff40f109d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47ad7ca9-9365-4fc9-8cd7-1eaff40f109d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a18ff38e8752d06b3f9780e899195848', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c5f6ba5220224e308dfc79d5d3a2884d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fb8c0fc8795050e16ca8e86b14a5e556fe4c187f8e6900e3556513b10b6632fbe1de179f4b1b91deda97042a6a686fbdb5553b0dc895b25811aa3a2a82f3fff', 'id': '47ad7ca9-9365-4fc9-8cd7-1eaff40f109d', 'created_at': datetime.datetime(2026, 6, 25, 16, 22, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 22, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47ad7ca9-9365-4fc9-8cd7-1eaff40f109d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85bc55dc-6fad-43e3-ab4e-063d65d3f4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:22:55 devstack sudo[110399]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9" returned: 0 in 1.162s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:55 devstack cinder-volume[93651]: DEBUG cinder.utils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Path /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46 not found in is_blk_device check {{(pid=93651) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:22:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:55 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Volume volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 (508e4602-b54a-4cc4-92dd-29db89b4e2f2): created successfully Jun 25 18:22:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85bc55dc-6fad-43e3-ab4e-063d65d3f4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:22:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Flow 'volume_create_manager' (4d74af58-0b47-45dc-bfb9-cddd1f6fe1e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:22:55 devstack sudo[110408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46 Jun 25 18:22:55 devstack sudo[110408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:55 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-40a7bec7-2d86-49ed-b14f-f65ba3a03aed tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Created volume successfully. Jun 25 18:22:56 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Acquiring lock "cinder-508e4602-b54a-4cc4-92dd-29db89b4e2f2-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:56 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Lock "cinder-508e4602-b54a-4cc4-92dd-29db89b4e2f2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:56 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Acquiring lock "cinder-quobyte-508e4602-b54a-4cc4-92dd-29db89b4e2f2" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:56 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Lock "cinder-quobyte-508e4602-b54a-4cc4-92dd-29db89b4e2f2" acquired by "delete_volume" :: waited 0.038s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:56 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e8702f-9006-4930-9dde-964385907f9f]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:56 devstack sudo[110410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 Jun 25 18:22:56 devstack sudo[110410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:58 devstack sudo[110410]: pam_unix(sudo:session): session closed for user root Jun 25 18:22:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2" returned: 0 in 1.640s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:22:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:22:58 devstack sudo[110429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 Jun 25 18:22:58 devstack sudo[110429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:22:58 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=63,cinder:INSERT=22,cinder:UPDATE=65,cinder:DELETE=8 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:22:58 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-0e882060-8cf3-48c7-9bde-2dea460eac03 req-596b7220-9147-4042-a66a-5e4cdb7df6b7 tempest-TestShelveInstance-1314808157 None] Terminate volume connection completed successfully. Jun 25 18:22:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-0e882060-8cf3-48c7-9bde-2dea460eac03 req-596b7220-9147-4042-a66a-5e4cdb7df6b7 tempest-TestShelveInstance-1314808157 None] Deleting attachment 01ccad0a-13c7-4a31-9bf9-c785f443aa8b. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:22:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Acquiring lock "cinder-5f740125-1363-416b-b98a-8f95fdbc9b6e-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Lock "cinder-5f740125-1363-416b-b98a-8f95fdbc9b6e-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Acquiring lock "cinder-quobyte-5f740125-1363-416b-b98a-8f95fdbc9b6e" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:22:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Lock "cinder-quobyte-5f740125-1363-416b-b98a-8f95fdbc9b6e" acquired by "delete_volume" :: waited 0.048s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:22:59 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8a858c-bc07-4955-a25e-a598912a4064]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:22:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:00 devstack sudo[110432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e Jun 25 18:23:00 devstack sudo[110432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:00 devstack sudo[110429]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2" returned: 1 in 2.216s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:23:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:00 devstack sudo[110437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2 Jun 25 18:23:00 devstack sudo[110437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:01 devstack sudo[110432]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e" returned: 0 in 1.954s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:01 devstack sudo[110443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e Jun 25 18:23:01 devstack sudo[110443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:02 devstack sudo[110437]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-508e4602-b54a-4cc4-92dd-29db89b4e2f2" returned: 0 in 1.807s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Lock "cinder-quobyte-508e4602-b54a-4cc4-92dd-29db89b4e2f2" released by "delete_volume" :: held 5.826s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:02 devstack cinder-volume[93651]: WARNING cinder.quota [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:23:02 devstack cinder-volume[93651]: WARNING cinder.quota [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 25 18:23:02 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Created reservations ['83883f74-c347-4d90-8701-1192b23dc3ce', 'a3673b80-3068-47c7-8921-ebfb4cf05c4f', 'e145cc50-029e-4d5c-ba53-69806fe2f2c8', 'ddaf1025-3d1d-430e-8e6d-4ffafad7c002'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:02 devstack sudo[110446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:23:02 devstack sudo[110446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46" returned: 0 in 7.301s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:02 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c59ae8-96c6-4a59-9ba6-1fe03662e625]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:03 devstack sudo[110450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 Jun 25 18:23:03 devstack sudo[110450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:03 devstack sudo[110443]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5f740125-1363-416b-b98a-8f95fdbc9b6e" returned: 0 in 1.620s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Lock "cinder-quobyte-5f740125-1363-416b-b98a-8f95fdbc9b6e" released by "delete_volume" :: held 3.684s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:03 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Created reservations ['7f2bdbfd-caf3-40f2-9b89-a4c4cfdc837e', 'ece48451-d3e5-4489-b96d-dc1f924e1d1c', 'dff1aaff-3104-4811-bbc2-3fc67b145092', '7ecebc2a-c2d4-447e-b14b-d02a1d90b978'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:03 devstack sudo[110454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:23:03 devstack sudo[110454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:03 devstack sudo[110446]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.222s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:03 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:03 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Deleted volume successfully. Jun 25 18:23:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-712dd47e-cb83-429d-83aa-40b4c877afa6 tempest-VolumeAndVolumeTypeFromImageTest-1267805221 None] Lock "cinder-508e4602-b54a-4cc4-92dd-29db89b4e2f2-delete_volume" released by "delete_volume" :: held 7.576s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:04 devstack sudo[110450]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9" returned: 0 in 1.457s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Image conversion details: src /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9, size 1024.00 MB, duration 7.30 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:23:04 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Converted 1024.00 MB image at 140.22 MB/s Jun 25 18:23:04 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46 is being set with open permissions: ugo+rw Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:04 devstack sudo[110459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46 Jun 25 18:23:04 devstack sudo[110459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:04 devstack sudo[110454]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.932s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Deleted volume successfully. Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fc5c39b3-ed98-48af-b0e2-208ea3742bc1 tempest-TestStampPattern-177067603 None] Lock "cinder-5f740125-1363-416b-b98a-8f95fdbc9b6e-delete_volume" released by "delete_volume" :: held 5.150s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Acquiring lock "cinder-8ab149af-8655-4ef2-8107-05d508a81714-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Lock "cinder-8ab149af-8655-4ef2-8107-05d508a81714-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Acquiring lock "cinder-quobyte-bd279dff-94d9-42cc-9397-bcb17c93ab5d" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Lock "cinder-quobyte-bd279dff-94d9-42cc-9397-bcb17c93ab5d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Acquiring lock "cinder-quobyte-8ab149af-8655-4ef2-8107-05d508a81714" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Lock "cinder-quobyte-8ab149af-8655-4ef2-8107-05d508a81714" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Deleting offline snapshot 8ab149af-8655-4ef2-8107-05d508a81714 of volume bd279dff-94d9-42cc-9397-bcb17c93ab5d {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] snapshot_file for this snap is: volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c105dc-fc80-4591-814c-fb4024cd2582]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:05 devstack sudo[110462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 Jun 25 18:23:05 devstack sudo[110462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:05 devstack sudo[110459]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46" returned: 0 in 0.949s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-2766bcc7-e05d-4c5f-b05f-d2d1271cec46" released by "_copy_volume_from_snapshot" :: held 12.278s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-quobyte-c7ff7ebf-f964-4dc1-9278-8ba889eeb20c" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-c7ff7ebf-f964-4dc1-9278-8ba889eeb20c" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Deleting offline snapshot c7ff7ebf-f964-4dc1-9278-8ba889eeb20c of volume 760c61a0-cf16-426a-b559-3c1aef74ddb9 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:23:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] snapshot_file for this snap is: volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:23:05 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc993748-7b4d-463b-9972-6e9cc4fb17c0]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:05 devstack sudo[110465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c Jun 25 18:23:05 devstack sudo[110465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-bfa3c75a-ab93-461d-a9f3-c905ed1c76aa req-dd34c153-2b80-49be-9688-0c8eb584b4aa tempest-TestShelveInstance-1314808157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:06 devstack sudo[110462]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714" returned: 0 in 1.088s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:23:06 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[099ed7ec-f5ec-46b6-b2e4-b306f8c56e18]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:06 devstack sudo[110479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d Jun 25 18:23:06 devstack sudo[110479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:06 devstack sudo[110465]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c" returned: 0 in 0.986s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-760c61a0-cf16-426a-b559-3c1aef74ddb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:23:06 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8f3a4b-3ccd-4a85-911e-179a7aa6a740]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:06 devstack sudo[110484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 Jun 25 18:23:06 devstack sudo[110484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:07 devstack sudo[110479]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d" returned: 0 in 1.054s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:07 devstack sudo[110489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 Jun 25 18:23:07 devstack sudo[110489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:07 devstack sudo[110484]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9" returned: 0 in 0.984s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:07 devstack sudo[110494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c Jun 25 18:23:07 devstack sudo[110494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:08 devstack sudo[110489]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714" returned: 0 in 0.947s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:08 devstack sudo[110501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714 Jun 25 18:23:08 devstack sudo[110501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:08 devstack sudo[110494]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c" returned: 0 in 0.911s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:08 devstack sudo[110506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c Jun 25 18:23:08 devstack sudo[110506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:08 devstack sudo[110501]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d.8ab149af-8655-4ef2-8107-05d508a81714" returned: 0 in 0.806s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:08 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Lock "cinder-quobyte-8ab149af-8655-4ef2-8107-05d508a81714" released by "_delete_snapshot" :: held 4.023s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:08 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Lock "cinder-quobyte-bd279dff-94d9-42cc-9397-bcb17c93ab5d" released by "delete_snapshot" :: held 4.052s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Created reservations ['4af8d405-b47f-43cd-87ea-4743003cd2d5', 'a4275710-4c36-4dc8-bae4-a4fd60cece18', 'f81ee66d-6fc8-4ffe-94c8-df9eb8a595d3', '07be094b-ab42-4651-ba2a-297225e8dc89'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:09 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Delete snapshot completed successfully. Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c52ab391-6455-4630-b914-18f9321b858c tempest-TestStampPattern-177067603 None] Lock "cinder-8ab149af-8655-4ef2-8107-05d508a81714-delete_snapshot" released by "delete_snapshot" :: held 4.248s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:09 devstack sudo[110506]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9.c7ff7ebf-f964-4dc1-9278-8ba889eeb20c" returned: 0 in 0.846s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-c7ff7ebf-f964-4dc1-9278-8ba889eeb20c" released by "_delete_snapshot" :: held 3.902s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.720s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-bfa3c75a-ab93-461d-a9f3-c905ed1c76aa req-dd34c153-2b80-49be-9688-0c8eb584b4aa tempest-TestShelveInstance-1314808157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.441s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6f136b-a33d-456e-97ea-afc87d31b17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46', 'volume_size': 1, 'source_volid': '760c61a0-cf16-426a-b559-3c1aef74ddb9', 'source_volstatus': 'available'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b93fe1-a595-49da-ad0a-252c0875da66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c3b2a9-10fa-4d88-953c-7f204aa43050]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-bfa3c75a-ab93-461d-a9f3-c905ed1c76aa req-dd34c153-2b80-49be-9688-0c8eb584b4aa tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:09 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Volume volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46 (2766bcc7-e05d-4c5f-b05f-d2d1271cec46): created successfully Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b93fe1-a595-49da-ad0a-252c0875da66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Flow 'volume_create_manager' (0a4b8156-5d49-40f2-950e-51f0e4ed6df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:09 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e4ba65d6-2b3b-48d1-9519-3dc3f9a46595 tempest-VolumesGetTest-1914453881 None] Created volume successfully. Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Flow 'volume_create_manager' (1df850f6-bc46-4514-ada8-fb8051f6978f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376e52c2-0dd8-41b9-bda2-3a6e225cd248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376e52c2-0dd8-41b9-bda2-3a6e225cd248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1482217074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e5b35b-c9a0-4301-a9c8-d3534b8eb415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85aa31ce747d4700be30af2279e6ead0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:10Z,use_quota=True,user_id='4f5d2af78e6d401d9ab9d701e2aac8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f843c461-c7eb-46b1-9c64-2160e3cb2dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:09 devstack sudo[110510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 Jun 25 18:23:09 devstack sudo[110510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f843c461-c7eb-46b1-9c64-2160e3cb2dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf4e598-eda1-4112-8960-10fbd60c5e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf4e598-eda1-4112-8960-10fbd60c5e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e5b35b-c9a0-4301-a9c8-d3534b8eb415', 'volume_name': 'volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecdc706-202a-4c8d-abe6-e4da9bfe4973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecdc706-202a-4c8d-abe6-e4da9bfe4973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0176d2-4a5e-488c-b0ad-c432cd45a530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:09 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume 88e5b35b-c9a0-4301-a9c8-d3534b8eb415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415', 'volume_size': 1} Jun 25 18:23:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:10 devstack sudo[110510]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-bfa3c75a-ab93-461d-a9f3-c905ed1c76aa req-dd34c153-2b80-49be-9688-0c8eb584b4aa tempest-TestShelveInstance-1314808157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8" returned: 0 in 1.075s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-bfa3c75a-ab93-461d-a9f3-c905ed1c76aa req-dd34c153-2b80-49be-9688-0c8eb584b4aa tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:10 devstack sudo[110516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 Jun 25 18:23:10 devstack sudo[110516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:10 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Flow 'volume_create_manager' (66381e3b-adf9-46a9-9fba-5e2387b2a517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d9c854-c979-4dfc-ac28-f33e6a529db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d9c854-c979-4dfc-ac28-f33e6a529db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2099686579',display_name='tempest-VolumesGetTest-Volume-153483586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5051a8df-c031-4c53-bafa-a5708f44b7be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55878fcf9964ecab5504e35fe766393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:11Z,use_quota=True,user_id='d9a0a4c582b6445dbd0225cc1fe2158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1216f507-b985-48a2-9aa3-a56b13a2f6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1216f507-b985-48a2-9aa3-a56b13a2f6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b0b5f9-fbf0-44f9-a43f-0466f4af1368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b0b5f9-fbf0-44f9-a43f-0466f4af1368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5051a8df-c031-4c53-bafa-a5708f44b7be', 'volume_name': 'volume-5051a8df-c031-4c53-bafa-a5708f44b7be', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7175cd-e429-4ec2-aca4-cb7327b9f98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7175cd-e429-4ec2-aca4-cb7327b9f98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dee2ac4-9d5d-4b47-9d5a-0035534631cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:11 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Volume 5051a8df-c031-4c53-bafa-a5708f44b7be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5051a8df-c031-4c53-bafa-a5708f44b7be', 'volume_size': 1} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:11 devstack sudo[110516]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-bfa3c75a-ab93-461d-a9f3-c905ed1c76aa req-dd34c153-2b80-49be-9688-0c8eb584b4aa tempest-TestShelveInstance-1314808157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8" returned: 1 in 1.067s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-bfa3c75a-ab93-461d-a9f3-c905ed1c76aa req-dd34c153-2b80-49be-9688-0c8eb584b4aa tempest-TestShelveInstance-1314808157 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-bfa3c75a-ab93-461d-a9f3-c905ed1c76aa req-dd34c153-2b80-49be-9688-0c8eb584b4aa tempest-TestShelveInstance-1314808157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.209s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.882s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1482217074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e5b35b-c9a0-4301-a9c8-d3534b8eb415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85aa31ce747d4700be30af2279e6ead0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:10Z,use_quota=True,user_id='4f5d2af78e6d401d9ab9d701e2aac8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Creating volume 88e5b35b-c9a0-4301-a9c8-d3534b8eb415 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:11 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:11 devstack sudo[110521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 1073741824 Jun 25 18:23:11 devstack sudo[110521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-bfa3c75a-ab93-461d-a9f3-c905ed1c76aa req-dd34c153-2b80-49be-9688-0c8eb584b4aa tempest-TestShelveInstance-1314808157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-8efdc544-edc8-4ffd-9452-881348c116b8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77dd5cd4-b1d9-46fc-b2c5-09ae97314f1a', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:23:11 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-bfa3c75a-ab93-461d-a9f3-c905ed1c76aa req-dd34c153-2b80-49be-9688-0c8eb584b4aa tempest-TestShelveInstance-1314808157 None] attachment_update completed successfully. Jun 25 18:23:12 devstack sudo[110521]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 1073741824" returned: 0 in 1.275s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:13 devstack sudo[110570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 Jun 25 18:23:13 devstack sudo[110570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:13 devstack sudo[110570]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415" returned: 0 in 0.766s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] <== create_volume: return (2097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.587s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2099686579',display_name='tempest-VolumesGetTest-Volume-153483586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5051a8df-c031-4c53-bafa-a5708f44b7be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55878fcf9964ecab5504e35fe766393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:11Z,use_quota=True,user_id='d9a0a4c582b6445dbd0225cc1fe2158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Creating volume 5051a8df-c031-4c53-bafa-a5708f44b7be {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:13 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5051a8df-c031-4c53-bafa-a5708f44b7be 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:13 devstack sudo[110575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5051a8df-c031-4c53-bafa-a5708f44b7be 1073741824 Jun 25 18:23:13 devstack sudo[110575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0176d2-4a5e-488c-b0ad-c432cd45a530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b712811-06d7-467b-a31c-a12196bae3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:13 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 (88e5b35b-c9a0-4301-a9c8-d3534b8eb415): created successfully Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b712811-06d7-467b-a31c-a12196bae3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Flow 'volume_create_manager' (1df850f6-bc46-4514-ada8-fb8051f6978f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:13 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-b3c57b75-9a35-4c8c-84ff-0eca641b6e2a tempest-CreateVolumesFromSnapshotTest-1915020811 None] Created volume successfully. Jun 25 18:23:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:15 devstack sudo[110575]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5051a8df-c031-4c53-bafa-a5708f44b7be 1073741824" returned: 0 in 1.285s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5051a8df-c031-4c53-bafa-a5708f44b7be {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:15 devstack sudo[110581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5051a8df-c031-4c53-bafa-a5708f44b7be Jun 25 18:23:15 devstack sudo[110581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:15 devstack sudo[110581]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5051a8df-c031-4c53-bafa-a5708f44b7be" returned: 0 in 0.752s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:15 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.357s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:15 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Creating offline snapshot bbe4a813-08c7-45b4-ae52-bd35310fee7d of volume 88e5b35b-c9a0-4301-a9c8-d3534b8eb415 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:23:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dee2ac4-9d5d-4b47-9d5a-0035534631cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5051a8df-c031-4c53-bafa-a5708f44b7be', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c350d6-0a0b-4b1a-be9e-f7d4975539cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:15 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c61386-1e76-4af2-b7e2-d205987c1eb1]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:15 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Volume volume-5051a8df-c031-4c53-bafa-a5708f44b7be (5051a8df-c031-4c53-bafa-a5708f44b7be): created successfully Jun 25 18:23:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c350d6-0a0b-4b1a-be9e-f7d4975539cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Flow 'volume_create_manager' (66381e3b-adf9-46a9-9fba-5e2387b2a517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:15 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-34d2e079-b560-45e9-b86d-38bcc6cf08b3 tempest-VolumesGetTest-1914453881 None] Created volume successfully. Jun 25 18:23:16 devstack sudo[110584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 Jun 25 18:23:16 devstack sudo[110584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-5051a8df-c031-4c53-bafa-a5708f44b7be-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Lock "cinder-5051a8df-c031-4c53-bafa-a5708f44b7be-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-quobyte-5051a8df-c031-4c53-bafa-a5708f44b7be" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-5051a8df-c031-4c53-bafa-a5708f44b7be" acquired by "delete_volume" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:16 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[df04487f-2c7b-43ad-8dfa-bd5add05eb4a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5051a8df-c031-4c53-bafa-a5708f44b7be {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:16 devstack sudo[110584]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415" returned: 0 in 1.034s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:16 devstack sudo[110591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d 1G Jun 25 18:23:16 devstack sudo[110591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:16 devstack sudo[110590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5051a8df-c031-4c53-bafa-a5708f44b7be Jun 25 18:23:16 devstack sudo[110590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:17 devstack sudo[110590]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5051a8df-c031-4c53-bafa-a5708f44b7be" returned: 0 in 0.968s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5051a8df-c031-4c53-bafa-a5708f44b7be {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:17 devstack sudo[110602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5051a8df-c031-4c53-bafa-a5708f44b7be Jun 25 18:23:17 devstack sudo[110602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:17 devstack sudo[110591]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d 1G" returned: 0 in 1.063s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:18 devstack sudo[110605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d Jun 25 18:23:18 devstack sudo[110605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:18 devstack sudo[110602]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5051a8df-c031-4c53-bafa-a5708f44b7be" returned: 0 in 0.744s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-5051a8df-c031-4c53-bafa-a5708f44b7be" released by "delete_volume" :: held 1.768s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:18 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Created reservations ['51754c82-7be0-44a6-97ab-a37e85b86259', '3bb7c112-d753-4565-9ecf-0ddef2faf30a', '03fcfb37-d2a2-4b2f-bf54-fe118ce0975f', '68d448a8-c651-49d5-a424-908ac59d7f24'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:18 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:18 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:18 devstack sudo[110612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:23:18 devstack sudo[110612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:18 devstack sudo[110605]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d" returned: 0 in 0.839s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:18 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d is being set with open permissions: ugo+rw Jun 25 18:23:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:18 devstack sudo[110614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d Jun 25 18:23:18 devstack sudo[110614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Acquiring lock "cinder-bd279dff-94d9-42cc-9397-bcb17c93ab5d-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Lock "cinder-bd279dff-94d9-42cc-9397-bcb17c93ab5d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Acquiring lock "cinder-quobyte-bd279dff-94d9-42cc-9397-bcb17c93ab5d" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Lock "cinder-quobyte-bd279dff-94d9-42cc-9397-bcb17c93ab5d" acquired by "delete_volume" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-2766bcc7-e05d-4c5f-b05f-d2d1271cec46-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c5a3a6-304c-4ba9-b8ad-6e86e74fccb2]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Lock "cinder-2766bcc7-e05d-4c5f-b05f-d2d1271cec46-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-quobyte-2766bcc7-e05d-4c5f-b05f-d2d1271cec46" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-2766bcc7-e05d-4c5f-b05f-d2d1271cec46" acquired by "delete_volume" :: waited 0.029s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf684e4b-e4f0-4059-9e1d-93b754ad9fb5]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:19 devstack sudo[110616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d Jun 25 18:23:19 devstack sudo[110616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:19 devstack sudo[110618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46 Jun 25 18:23:19 devstack sudo[110618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:19 devstack sudo[110614]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d" returned: 0 in 0.950s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:19 devstack sudo[110612]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.072s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:19 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Deleted volume successfully. Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3adab71b-6d19-4d88-80aa-3f755c7c3f13 tempest-VolumesGetTest-1914453881 None] Lock "cinder-5051a8df-c031-4c53-bafa-a5708f44b7be-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:19 devstack sudo[110622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.info Jun 25 18:23:19 devstack sudo[110622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:20 devstack sudo[110616]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d" returned: 0 in 1.088s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:20 devstack sudo[110674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d Jun 25 18:23:20 devstack sudo[110674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:20 devstack sudo[110618]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46" returned: 0 in 1.191s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:20 devstack sudo[110702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46 Jun 25 18:23:20 devstack sudo[110702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:20 devstack sudo[110622]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.info" returned: 0 in 0.877s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:20 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.info is being set with open permissions: ugo+rw Jun 25 18:23:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:20 devstack sudo[110704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.info Jun 25 18:23:20 devstack sudo[110704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:21 devstack sudo[110674]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-bd279dff-94d9-42cc-9397-bcb17c93ab5d" returned: 0 in 0.809s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Lock "cinder-quobyte-bd279dff-94d9-42cc-9397-bcb17c93ab5d" released by "delete_volume" :: held 1.993s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Created reservations ['8a4f7ec0-cf94-42c6-aa19-5c76929cfd2d', '35e8fed1-3d8f-43ba-89da-2bc292cac384', 'b774a723-eba9-4e37-ade4-3ac988ec204a', 'd2d359f0-19c0-457b-9055-37e4bb3ec43e'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:21 devstack sudo[110709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:23:21 devstack sudo[110709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:21 devstack sudo[110702]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2766bcc7-e05d-4c5f-b05f-d2d1271cec46" returned: 0 in 0.804s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-2766bcc7-e05d-4c5f-b05f-d2d1271cec46" released by "delete_volume" :: held 2.080s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:21 devstack sudo[110704]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.info" returned: 0 in 0.743s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.655s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:21 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-0d3c0b6a-8d48-4fd0-9022-b6ff949a72a2 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Create snapshot completed successfully Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=86,cinder:SELECT=86,cinder:INSERT=19,cinder:DELETE=7 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Created reservations ['9b9b2872-33f1-43b3-84b2-6f039ca6a130', 'f1db8449-ded0-4033-8285-430e20be8c39', '1a61140e-203f-4248-810f-30368abbb7bb', 'a358bdc2-6308-4fa3-b1b1-0e4558f95e74'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:21 devstack sudo[110715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:23:21 devstack sudo[110715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:22 devstack sudo[110709]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.034s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:22 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Deleted volume successfully. Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6462ebc1-cd74-4230-9dbb-7cc62624c927 tempest-TestStampPattern-177067603 None] Lock "cinder-bd279dff-94d9-42cc-9397-bcb17c93ab5d-delete_volume" released by "delete_volume" :: held 3.367s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Flow 'volume_create_manager' (c90816fc-164e-4d73-9a52-4ffadb30964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:22 devstack sudo[110715]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4640948c-0785-428a-8a33-1f3ce048baea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-760c61a0-cf16-426a-b559-3c1aef74ddb9-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.092s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:22 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Deleted volume successfully. Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4640948c-0785-428a-8a33-1f3ce048baea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2147337361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e94053d-3571-41a0-9b07-730137ade62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85aa31ce747d4700be30af2279e6ead0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:23Z,use_quota=True,user_id='4f5d2af78e6d401d9ab9d701e2aac8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f0edf1-fa55-477d-a1f9-ea687000318a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f0edf1-fa55-477d-a1f9-ea687000318a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5102fb5e-de84-47cd-8ab6-a3643b0728de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5102fb5e-de84-47cd-8ab6-a3643b0728de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e94053d-3571-41a0-9b07-730137ade62b', 'volume_name': 'volume-5e94053d-3571-41a0-9b07-730137ade62b', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14b1b72-3262-45d6-8b5e-930becbf59c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14b1b72-3262-45d6-8b5e-930becbf59c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5474ddf-57e2-45a3-89e0-b2857bc5478b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:22 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume 5e94053d-3571-41a0-9b07-730137ade62b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e94053d-3571-41a0-9b07-730137ade62b', 'volume_size': 1} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2147337361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e94053d-3571-41a0-9b07-730137ade62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85aa31ce747d4700be30af2279e6ead0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:23Z,use_quota=True,user_id='4f5d2af78e6d401d9ab9d701e2aac8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Creating volume 5e94053d-3571-41a0-9b07-730137ade62b {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:22 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5e94053d-3571-41a0-9b07-730137ade62b 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Lock "cinder-760c61a0-cf16-426a-b559-3c1aef74ddb9-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:22 devstack sudo[110719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5e94053d-3571-41a0-9b07-730137ade62b 1073741824 Jun 25 18:23:22 devstack sudo[110719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:22 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-38b9749f-96e8-4694-b10c-c63b80afa414 tempest-VolumesGetTest-1914453881 None] Lock "cinder-2766bcc7-e05d-4c5f-b05f-d2d1271cec46-delete_volume" released by "delete_volume" :: held 3.695s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-quobyte-760c61a0-cf16-426a-b559-3c1aef74ddb9" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-760c61a0-cf16-426a-b559-3c1aef74ddb9" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ba776d-f2dd-4351-8e4e-60ead945b768]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:23 devstack sudo[110721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 Jun 25 18:23:23 devstack sudo[110721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Flow 'volume_create_manager' (7e1d1914-a5e3-48bc-bbc4-1d2cd7efebe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c5bf7f-9617-4f00-ab32-82f3b2064c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c5bf7f-9617-4f00-ab32-82f3b2064c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1745707317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8922374-5d7d-4daa-8b05-b12d2fcdcfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85aa31ce747d4700be30af2279e6ead0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:23Z,use_quota=True,user_id='4f5d2af78e6d401d9ab9d701e2aac8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca8e52d-c4c4-4479-9e8a-3760b8477b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca8e52d-c4c4-4479-9e8a-3760b8477b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8cd92e-523d-4c4c-b1b0-f2b4b579a0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8cd92e-523d-4c4c-b1b0-f2b4b579a0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8922374-5d7d-4daa-8b05-b12d2fcdcfd3', 'volume_name': 'volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ee76ac-5306-442b-a6b9-cca80cd6bafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ee76ac-5306-442b-a6b9-cca80cd6bafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105be01b-7ffb-4beb-95b4-e29efd07d85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:23 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume a8922374-5d7d-4daa-8b05-b12d2fcdcfd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3', 'volume_size': 1} Jun 25 18:23:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Flow 'volume_create_manager' (c893677d-fc5d-4d58-b8d6-982abb22f1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1b53f5-0733-4d01-915e-58817167faac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1b53f5-0733-4d01-915e-58817167faac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1525382900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159a7e97-0b25-43b0-9ba8-7fc6668b7535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85aa31ce747d4700be30af2279e6ead0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:24Z,use_quota=True,user_id='4f5d2af78e6d401d9ab9d701e2aac8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acc0419-86e7-4245-8115-aa5ac20da522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acc0419-86e7-4245-8115-aa5ac20da522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13aaaf60-e08a-47fb-91fa-1fda88c419cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13aaaf60-e08a-47fb-91fa-1fda88c419cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '159a7e97-0b25-43b0-9ba8-7fc6668b7535', 'volume_name': 'volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c8604c-1931-4c36-b516-b9225a0a9510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c8604c-1931-4c36-b516-b9225a0a9510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e414df0-8ca9-4c2c-8c6a-31eb83381b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:24 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume 159a7e97-0b25-43b0-9ba8-7fc6668b7535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535', 'volume_size': 1} Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:24 devstack sudo[110719]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5e94053d-3571-41a0-9b07-730137ade62b 1073741824" returned: 0 in 1.787s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5e94053d-3571-41a0-9b07-730137ade62b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:24 devstack sudo[110721]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9" returned: 0 in 1.790s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:24 devstack sudo[111091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5e94053d-3571-41a0-9b07-730137ade62b Jun 25 18:23:24 devstack sudo[111091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:24 devstack sudo[111096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9 Jun 25 18:23:24 devstack sudo[111096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:25 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Flow 'volume_create_manager' (af97f54e-fe13-4b92-9057-536c7d507315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c68dc7b-167e-40d9-8a98-50c0d20b5d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c68dc7b-167e-40d9-8a98-50c0d20b5d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1001778499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ab9237-ee49-4d96-8b3f-6407013da49a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85aa31ce747d4700be30af2279e6ead0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:25Z,use_quota=True,user_id='4f5d2af78e6d401d9ab9d701e2aac8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1601c920-a3c9-4529-8c9b-a51e010927cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1601c920-a3c9-4529-8c9b-a51e010927cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9054eb-3b0b-49fd-a2e2-e65705dd019d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9054eb-3b0b-49fd-a2e2-e65705dd019d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7ab9237-ee49-4d96-8b3f-6407013da49a', 'volume_name': 'volume-b7ab9237-ee49-4d96-8b3f-6407013da49a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e45f3b-468d-449c-a11f-d7d6e06e068d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e45f3b-468d-449c-a11f-d7d6e06e068d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520d19a1-e128-48a8-9d8c-fcd4813aedb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:25 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume b7ab9237-ee49-4d96-8b3f-6407013da49a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7ab9237-ee49-4d96-8b3f-6407013da49a', 'volume_size': 1} Jun 25 18:23:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:26 devstack sudo[111096]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-760c61a0-cf16-426a-b559-3c1aef74ddb9" returned: 0 in 1.387s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-760c61a0-cf16-426a-b559-3c1aef74ddb9" released by "delete_volume" :: held 3.322s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:26 devstack sudo[111091]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Flow 'volume_create_manager' (958d592d-0165-4c85-9e6d-9a4cf7e34dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f522968f-6432-4ba6-b4f0-3d4e6616cf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5e94053d-3571-41a0-9b07-730137ade62b" returned: 0 in 1.605s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] <== create_volume: return (3515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.519s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.841s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1745707317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8922374-5d7d-4daa-8b05-b12d2fcdcfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85aa31ce747d4700be30af2279e6ead0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:23Z,use_quota=True,user_id='4f5d2af78e6d401d9ab9d701e2aac8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Creating volume a8922374-5d7d-4daa-8b05-b12d2fcdcfd3 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:26 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f522968f-6432-4ba6-b4f0-3d4e6616cf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1535791545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17efec8-10e0-4711-9949-db790c224f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85aa31ce747d4700be30af2279e6ead0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:26Z,use_quota=True,user_id='4f5d2af78e6d401d9ab9d701e2aac8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:26 devstack sudo[111128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3 1073741824 Jun 25 18:23:26 devstack sudo[111128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73efce96-cd8b-4752-a855-55eadcefbb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73efce96-cd8b-4752-a855-55eadcefbb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9762df-dd64-495b-80e8-7a65ed8307eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9762df-dd64-495b-80e8-7a65ed8307eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f17efec8-10e0-4711-9949-db790c224f66', 'volume_name': 'volume-f17efec8-10e0-4711-9949-db790c224f66', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b005dea-02fa-48d9-ab92-a1227cfd712d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b005dea-02fa-48d9-ab92-a1227cfd712d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cd7308-9d93-423d-9ea2-6886b5610863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:26 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume f17efec8-10e0-4711-9949-db790c224f66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f17efec8-10e0-4711-9949-db790c224f66', 'volume_size': 1} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5474ddf-57e2-45a3-89e0-b2857bc5478b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e94053d-3571-41a0-9b07-730137ade62b', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14aea8f2-6395-485c-bc76-1f1e92f54507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:26 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume volume-5e94053d-3571-41a0-9b07-730137ade62b (5e94053d-3571-41a0-9b07-730137ade62b): created successfully Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14aea8f2-6395-485c-bc76-1f1e92f54507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Flow 'volume_create_manager' (c90816fc-164e-4d73-9a52-4ffadb30964b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Created reservations ['968b276c-20cb-440d-8302-19dc62acde5e', '9d0fd7f5-5e00-4155-87bb-e5b79f75e7d0', '087847c6-8ebc-4444-ac97-5c498797705d', 'fbe8c3e9-1cca-4799-849c-63ca7acca23a'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:26 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4ce8969a-a94e-4022-8d04-a2b4f2d0e7cc tempest-CreateVolumesFromSnapshotTest-1915020811 None] Created volume successfully. Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:26 devstack sudo[111130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:23:26 devstack sudo[111130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:28 devstack sudo[111130]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.467s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:28 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:28 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Deleted volume successfully. Jun 25 18:23:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8ba9e3c9-3694-4b58-abc2-275bfda3a071 tempest-VolumesGetTest-1914453881 None] Lock "cinder-760c61a0-cf16-426a-b559-3c1aef74ddb9-delete_volume" released by "delete_volume" :: held 5.427s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:28 devstack sudo[111128]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3 1073741824" returned: 0 in 1.961s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:28 devstack sudo[111172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3 Jun 25 18:23:28 devstack sudo[111172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:29 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Flow 'volume_create_manager' (e2ded5a2-957f-4554-8eb3-4cfdead0cf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8755908a-ed58-454b-93d8-780bdad2e237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8755908a-ed58-454b-93d8-780bdad2e237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1275810979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71999656-d1b1-48d3-ac89-111b194d4e06,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e55878fcf9964ecab5504e35fe766393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:29Z,use_quota=True,user_id='d9a0a4c582b6445dbd0225cc1fe2158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a50098c-f84c-47cc-a80e-dcb17a05e38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a50098c-f84c-47cc-a80e-dcb17a05e38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27efe53d-e6dc-45aa-a28f-5f9e67a61d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:29 devstack cinder-volume[93651]: DEBUG cinder.image.glance [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Creating Keystone auth plugin from conf {{(pid=93651) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:23:30 devstack sudo[111172]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3" returned: 0 in 1.492s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] <== create_volume: return (3599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.607s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.540s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1525382900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159a7e97-0b25-43b0-9ba8-7fc6668b7535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85aa31ce747d4700be30af2279e6ead0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:24Z,use_quota=True,user_id='4f5d2af78e6d401d9ab9d701e2aac8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Creating volume 159a7e97-0b25-43b0-9ba8-7fc6668b7535 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:30 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:30 devstack sudo[111178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535 1073741824 Jun 25 18:23:30 devstack sudo[111178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105be01b-7ffb-4beb-95b4-e29efd07d85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49bdfed-d839-446e-b2cb-6d81e969947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:30 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3 (a8922374-5d7d-4daa-8b05-b12d2fcdcfd3): created successfully Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49bdfed-d839-446e-b2cb-6d81e969947b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Flow 'volume_create_manager' (7e1d1914-a5e3-48bc-bbc4-1d2cd7efebe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:30 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-3b225985-5abf-4e6c-abf4-a2c07f09bf42 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Created volume successfully. Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27efe53d-e6dc-45aa-a28f-5f9e67a61d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '71999656-d1b1-48d3-ac89-111b194d4e06', 'volume_name': 'volume-71999656-d1b1-48d3-ac89-111b194d4e06', 'volume_size': 1, 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab240da4b4934e58a24c7f836ed62427', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'created_at': datetime.datetime(2026, 6, 25, 15, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 58, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f40c5fd-84be-4dac-9a54-99392851236c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f40c5fd-84be-4dac-9a54-99392851236c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2b31ce-2733-4d6c-9941-53cebccadfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:30 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Volume 71999656-d1b1-48d3-ac89-111b194d4e06: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-71999656-d1b1-48d3-ac89-111b194d4e06', 'volume_size': 1, 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab240da4b4934e58a24c7f836ed62427', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'created_at': datetime.datetime(2026, 6, 25, 15, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 58, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 18:23:30 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Trying to clone 71999656-d1b1-48d3-ac89-111b194d4e06 from image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c at location (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]). {{(pid=93651) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:23:31 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_9t1eourwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:23:31 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Image download 20.69 MB at 20.69 MB/s Jun 25 18:23:31 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc32d727-a8ee-4844-b8a1-1b5d3eff3399]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_9t1eourwdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:31 devstack sudo[111186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_9t1eourwdevstack@QuobyteHD Jun 25 18:23:31 devstack sudo[111186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:31 devstack sudo[111178]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535 1073741824" returned: 0 in 1.785s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:31 devstack sudo[111189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535 Jun 25 18:23:31 devstack sudo[111189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:32 devstack sudo[111186]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_9t1eourwdevstack@QuobyteHD" returned: 0 in 1.113s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:32 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Temporary image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c is fetched for user d9a0a4c582b6445dbd0225cc1fe2158b. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:23:32 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a64cccd-a79d-4791-9b74-433d19e0838b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_9t1eourwdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:32 devstack sudo[111195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_9t1eourwdevstack@QuobyteHD Jun 25 18:23:32 devstack sudo[111195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:33 devstack sudo[111189]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535" returned: 0 in 1.089s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] <== create_volume: return (2948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.956s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.727s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1001778499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ab9237-ee49-4d96-8b3f-6407013da49a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85aa31ce747d4700be30af2279e6ead0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:25Z,use_quota=True,user_id='4f5d2af78e6d401d9ab9d701e2aac8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Creating volume b7ab9237-ee49-4d96-8b3f-6407013da49a {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:33 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b7ab9237-ee49-4d96-8b3f-6407013da49a 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e414df0-8ca9-4c2c-8c6a-31eb83381b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71daf192-317e-4052-8200-a05b96a2274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:33 devstack sudo[111198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b7ab9237-ee49-4d96-8b3f-6407013da49a 1073741824 Jun 25 18:23:33 devstack sudo[111198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:33 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535 (159a7e97-0b25-43b0-9ba8-7fc6668b7535): created successfully Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71daf192-317e-4052-8200-a05b96a2274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Flow 'volume_create_manager' (c893677d-fc5d-4d58-b8d6-982abb22f1b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:33 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-35e8a6a2-9b08-4fac-aeb1-5e7fd6f38866 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Created volume successfully. Jun 25 18:23:33 devstack sudo[111195]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_9t1eourwdevstack@QuobyteHD" returned: 0 in 0.984s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:34 devstack sudo[111198]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b7ab9237-ee49-4d96-8b3f-6407013da49a 1073741824" returned: 0 in 1.165s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b7ab9237-ee49-4d96-8b3f-6407013da49a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:34 devstack sudo[111209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b7ab9237-ee49-4d96-8b3f-6407013da49a Jun 25 18:23:34 devstack sudo[111209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:35 devstack sudo[111209]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b7ab9237-ee49-4d96-8b3f-6407013da49a" returned: 0 in 0.807s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.455s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1535791545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17efec8-10e0-4711-9949-db790c224f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85aa31ce747d4700be30af2279e6ead0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:26Z,use_quota=True,user_id='4f5d2af78e6d401d9ab9d701e2aac8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Creating volume f17efec8-10e0-4711-9949-db790c224f66 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:35 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f17efec8-10e0-4711-9949-db790c224f66 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:35 devstack sudo[111212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f17efec8-10e0-4711-9949-db790c224f66 1073741824 Jun 25 18:23:35 devstack sudo[111212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520d19a1-e128-48a8-9d8c-fcd4813aedb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ab9237-ee49-4d96-8b3f-6407013da49a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b57f75-1a63-4cf9-81c2-f58a536d6c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:35 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume volume-b7ab9237-ee49-4d96-8b3f-6407013da49a (b7ab9237-ee49-4d96-8b3f-6407013da49a): created successfully Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b57f75-1a63-4cf9-81c2-f58a536d6c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Flow 'volume_create_manager' (af97f54e-fe13-4b92-9057-536c7d507315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:35 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-cb7ab4a4-7c7e-4319-82ef-09a6aaaf67b9 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Created volume successfully. Jun 25 18:23:36 devstack sudo[111212]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f17efec8-10e0-4711-9949-db790c224f66 1073741824" returned: 0 in 1.088s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f17efec8-10e0-4711-9949-db790c224f66 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:36 devstack sudo[111219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f17efec8-10e0-4711-9949-db790c224f66 Jun 25 18:23:36 devstack sudo[111219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:37 devstack sudo[111219]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f17efec8-10e0-4711-9949-db790c224f66" returned: 0 in 0.859s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.454s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1275810979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71999656-d1b1-48d3-ac89-111b194d4e06,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e55878fcf9964ecab5504e35fe766393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:29Z,use_quota=True,user_id='d9a0a4c582b6445dbd0225cc1fe2158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Creating volume 71999656-d1b1-48d3-ac89-111b194d4e06 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:37 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:37 devstack sudo[111223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 1073741824 Jun 25 18:23:37 devstack sudo[111223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cd7308-9d93-423d-9ea2-6886b5610863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f17efec8-10e0-4711-9949-db790c224f66', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d720a2e-150d-4bc6-bd5f-4281b7b24be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:37 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Volume volume-f17efec8-10e0-4711-9949-db790c224f66 (f17efec8-10e0-4711-9949-db790c224f66): created successfully Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d720a2e-150d-4bc6-bd5f-4281b7b24be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:37 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Flow 'volume_create_manager' (958d592d-0165-4c85-9e6d-9a4cf7e34dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:37 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-21238d26-819e-496a-b835-2f5433c7a175 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Created volume successfully. Jun 25 18:23:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-f17efec8-10e0-4711-9949-db790c224f66-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-f17efec8-10e0-4711-9949-db790c224f66-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-quobyte-f17efec8-10e0-4711-9949-db790c224f66" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-f17efec8-10e0-4711-9949-db790c224f66" acquired by "delete_volume" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:38 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[f644380c-ae86-4589-918c-0b9d083f8311]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f17efec8-10e0-4711-9949-db790c224f66 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:38 devstack sudo[111223]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 1073741824" returned: 0 in 1.226s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:38 devstack sudo[111231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 Jun 25 18:23:38 devstack sudo[111231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:38 devstack sudo[111230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f17efec8-10e0-4711-9949-db790c224f66 Jun 25 18:23:38 devstack sudo[111230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:39 devstack sudo[111231]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06" returned: 0 in 0.863s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Attempting download of 2834cfdd-f1d3-4acf-a5ec-74a95c79167c ((None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}])) to volume 71999656-d1b1-48d3-ac89-111b194d4e06. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:39 devstack sudo[111238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:23:39 devstack sudo[111238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ff86c3-b97d-45e3-bed7-98afd6ef43a2]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_7es19dlm {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:39 devstack sudo[111230]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f17efec8-10e0-4711-9949-db790c224f66" returned: 0 in 1.191s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f17efec8-10e0-4711-9949-db790c224f66 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:39 devstack sudo[111241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f17efec8-10e0-4711-9949-db790c224f66 Jun 25 18:23:39 devstack sudo[111241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:39 devstack sudo[111240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_7es19dlm Jun 25 18:23:39 devstack sudo[111240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:40 devstack sudo[111238]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.815s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 28 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:23:40 devstack sudo[111241]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f17efec8-10e0-4711-9949-db790c224f66" returned: 0 in 1.133s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-f17efec8-10e0-4711-9949-db790c224f66" released by "delete_volume" :: held 2.392s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Created reservations ['c719d7d3-7cd4-426d-911d-4292f07f34c5', '0635bde6-996f-412b-b014-edf6bf436226', '3beca2f4-0d63-4c19-8552-403d5569ee72', 'abe1f30e-59af-442a-854f-c9eb1ca32a96'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:40 devstack sudo[111240]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_7es19dlm" returned: 0 in 1.312s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_7es19dlm {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:40 devstack sudo[111273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:23:40 devstack sudo[111273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:40 devstack sudo[111272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_7es19dlm Jun 25 18:23:40 devstack sudo[111272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-b7ab9237-ee49-4d96-8b3f-6407013da49a-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-b7ab9237-ee49-4d96-8b3f-6407013da49a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Flow 'volume_create_manager' (6078d6ea-cde5-489a-aa1c-6a81180887e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a73b0d-f04a-41e7-ae06-096f5f0a8378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-quobyte-b7ab9237-ee49-4d96-8b3f-6407013da49a" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a73b0d-f04a-41e7-ae06-096f5f0a8378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1997414124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97dcc0cd-be17-4700-b1a7-558d60137b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8f6e1182a4c3ba718cb0f48985497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:42Z,use_quota=True,user_id='66a1b929ac13427da5d52132a8b4cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1239cd2e-bb2f-436a-a0c2-99a1015642bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1239cd2e-bb2f-436a-a0c2-99a1015642bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4eec2b3-c1ca-4d37-be21-e87492e381ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:41 devstack sudo[111273]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4eec2b3-c1ca-4d37-be21-e87492e381ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97dcc0cd-be17-4700-b1a7-558d60137b8c', 'volume_name': 'volume-97dcc0cd-be17-4700-b1a7-558d60137b8c', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75242cb4-5254-4324-a87e-726456a468f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75242cb4-5254-4324-a87e-726456a468f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53646e0-883f-4141-b5fd-09743d6a9a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:41 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume 97dcc0cd-be17-4700-b1a7-558d60137b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97dcc0cd-be17-4700-b1a7-558d60137b8c', 'volume_size': 1} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1997414124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97dcc0cd-be17-4700-b1a7-558d60137b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8f6e1182a4c3ba718cb0f48985497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:42Z,use_quota=True,user_id='66a1b929ac13427da5d52132a8b4cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Creating volume 97dcc0cd-be17-4700-b1a7-558d60137b8c {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:41 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-97dcc0cd-be17-4700-b1a7-558d60137b8c 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.085s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-b7ab9237-ee49-4d96-8b3f-6407013da49a" acquired by "delete_volume" :: waited 0.103s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:41 devstack sudo[111279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-97dcc0cd-be17-4700-b1a7-558d60137b8c 1073741824 Jun 25 18:23:41 devstack sudo[111279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:41 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Deleted volume successfully. Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dfa369-c785-4f53-8637-38966f5a7187]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b7ab9237-ee49-4d96-8b3f-6407013da49a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c4ccf5a0-d048-4f92-8eaa-2619571d8783 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-f17efec8-10e0-4711-9949-db790c224f66-delete_volume" released by "delete_volume" :: held 3.895s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:42 devstack sudo[111272]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_7es19dlm" returned: 1 in 1.270s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_7es19dlm' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:23:42 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc1ba35-cc0b-4e62-8192-9cc6dd352912]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_9t1eourwdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:42 devstack sudo[111281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b7ab9237-ee49-4d96-8b3f-6407013da49a Jun 25 18:23:42 devstack sudo[111281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:42 devstack sudo[111282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_9t1eourwdevstack@QuobyteHD Jun 25 18:23:42 devstack sudo[111282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:42 devstack sudo[111281]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b7ab9237-ee49-4d96-8b3f-6407013da49a" returned: 0 in 1.013s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b7ab9237-ee49-4d96-8b3f-6407013da49a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:43 devstack sudo[111282]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_9t1eourwdevstack@QuobyteHD" returned: 0 in 0.984s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:43 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] 2834cfdd-f1d3-4acf-a5ec-74a95c79167c was qcow2, converting to raw {{(pid=93651) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:23:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_9t1eourwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:43 devstack sudo[111296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b7ab9237-ee49-4d96-8b3f-6407013da49a Jun 25 18:23:43 devstack sudo[111296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:43 devstack sudo[111301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_9t1eourwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 Jun 25 18:23:43 devstack sudo[111301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:43 devstack sudo[111279]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-97dcc0cd-be17-4700-b1a7-558d60137b8c 1073741824" returned: 0 in 1.302s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-97dcc0cd-be17-4700-b1a7-558d60137b8c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:43 devstack sudo[111309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-97dcc0cd-be17-4700-b1a7-558d60137b8c Jun 25 18:23:43 devstack sudo[111309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:43 devstack sudo[111296]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-b7ab9237-ee49-4d96-8b3f-6407013da49a" returned: 0 in 0.786s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-b7ab9237-ee49-4d96-8b3f-6407013da49a" released by "delete_volume" :: held 1.857s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:43 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Created reservations ['87d22780-3341-47df-b5c9-e980ca060c16', 'ad70204c-33ed-4565-bbde-56d671fb62d7', '4a0a01bb-3732-42e5-83c5-f0c5b8a450d2', '1833ccbc-a66a-4f5c-b616-61c351236c65'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:44 devstack sudo[111318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:23:44 devstack sudo[111318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-159a7e97-0b25-43b0-9ba8-7fc6668b7535-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-159a7e97-0b25-43b0-9ba8-7fc6668b7535-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:44 devstack sudo[111309]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-97dcc0cd-be17-4700-b1a7-558d60137b8c" returned: 0 in 0.927s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] <== create_volume: return (2299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.303s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-quobyte-159a7e97-0b25-43b0-9ba8-7fc6668b7535" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53646e0-883f-4141-b5fd-09743d6a9a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97dcc0cd-be17-4700-b1a7-558d60137b8c', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1245e4a9-0011-48d0-a5b5-8d5db796affb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-159a7e97-0b25-43b0-9ba8-7fc6668b7535" acquired by "delete_volume" :: waited 0.032s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:44 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume volume-97dcc0cd-be17-4700-b1a7-558d60137b8c (97dcc0cd-be17-4700-b1a7-558d60137b8c): created successfully Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1245e4a9-0011-48d0-a5b5-8d5db796affb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Flow 'volume_create_manager' (6078d6ea-cde5-489a-aa1c-6a81180887e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ff0b27-7af9-417b-98f8-29173b7e1a11]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:44 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-58c94275-7e94-4b5c-b5ea-e2ed866cf118 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Created volume successfully. Jun 25 18:23:44 devstack sudo[111320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535 Jun 25 18:23:44 devstack sudo[111320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:44 devstack sudo[111318]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.852s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:44 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Deleted volume successfully. Jun 25 18:23:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8532e1ee-fb58-437b-b3e1-578ec5d159c8 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-b7ab9237-ee49-4d96-8b3f-6407013da49a-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:45 devstack sudo[111320]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535" returned: 0 in 1.152s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:45 devstack sudo[111326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535 Jun 25 18:23:45 devstack sudo[111326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Flow 'volume_create_manager' (367db948-c8a3-44ef-919f-86852d9729f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f096e42-6b98-417b-bc80-201bce59e620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f096e42-6b98-417b-bc80-201bce59e620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1106569991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ddde5d3-cb05-4c3b-b8c9-537196003ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8f6e1182a4c3ba718cb0f48985497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:46Z,use_quota=True,user_id='66a1b929ac13427da5d52132a8b4cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed48e49-24ee-4c07-afb9-548ef0ded800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed48e49-24ee-4c07-afb9-548ef0ded800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:45 devstack sudo[111301]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e621be-c6b9-4fac-bd37-eb9e513abe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e621be-c6b9-4fac-bd37-eb9e513abe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ddde5d3-cb05-4c3b-b8c9-537196003ee8', 'volume_name': 'volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0011894-22e5-43c5-aa21-752ae272cfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0011894-22e5-43c5-aa21-752ae272cfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85265083-8635-48d3-a4ba-44964dca59a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:45 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume 7ddde5d3-cb05-4c3b-b8c9-537196003ee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8', 'volume_size': 1} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1106569991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ddde5d3-cb05-4c3b-b8c9-537196003ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8f6e1182a4c3ba718cb0f48985497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:46Z,use_quota=True,user_id='66a1b929ac13427da5d52132a8b4cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Creating volume 7ddde5d3-cb05-4c3b-b8c9-537196003ee8 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:45 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_9t1eourwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06" returned: 0 in 2.744s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2834cfdd-f1d3-4acf-a5ec-74a95c79167c_9t1eourwdevstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:23:45 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Converted 112.00 MB image at 40.76 MB/s Jun 25 18:23:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:45 devstack sudo[111329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8 1073741824 Jun 25 18:23:45 devstack sudo[111329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:45 devstack sudo[111330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 1G Jun 25 18:23:45 devstack sudo[111330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:46 devstack sudo[111326]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-159a7e97-0b25-43b0-9ba8-7fc6668b7535" returned: 0 in 0.903s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-159a7e97-0b25-43b0-9ba8-7fc6668b7535" released by "delete_volume" :: held 2.127s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:46 devstack sudo[111330]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 1G" returned: 0 in 0.859s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Created reservations ['b1932d31-cc72-40c7-87c8-637817a259c8', 'fce5a7e9-45cf-40de-ad49-919befd4ca89', '6b4e31c2-f249-4c7f-93e2-70366f8dd53f', '67aeb369-4730-4200-a9a0-bf00a7dd2a81'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[feeb3604-1d5f-434c-9be5-1f3c195ddc88]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:46 devstack sudo[111329]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8 1073741824" returned: 0 in 0.975s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:46 devstack sudo[111347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 Jun 25 18:23:46 devstack sudo[111347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Flow 'volume_create_manager' (58a3fcb5-ae8e-47e0-8cb6-03bf4b9273ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0c4527-75a5-45c7-971c-f8c887f21abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0c4527-75a5-45c7-971c-f8c887f21abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-674142773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2e6b6a-dc99-4443-9e20-330831c8bd28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8f6e1182a4c3ba718cb0f48985497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:46Z,use_quota=True,user_id='66a1b929ac13427da5d52132a8b4cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871395d9-cb4b-47dc-8ed2-412e9cebd7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871395d9-cb4b-47dc-8ed2-412e9cebd7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f4e75a-f321-45da-b354-d70f990dddc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f4e75a-f321-45da-b354-d70f990dddc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b2e6b6a-dc99-4443-9e20-330831c8bd28', 'volume_name': 'volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fb1681-022d-4c68-aedf-a72e764911a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fb1681-022d-4c68-aedf-a72e764911a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1070258e-7dc5-457a-bcdb-8ea98386baa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:47 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume 5b2e6b6a-dc99-4443-9e20-330831c8bd28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28', 'volume_size': 1} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:47 devstack sudo[111349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8 Jun 25 18:23:47 devstack sudo[111349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:47 devstack sudo[111353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:23:47 devstack sudo[111353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:47 devstack sudo[111347]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06" returned: 0 in 0.908s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:47 devstack sudo[111355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 Jun 25 18:23:47 devstack sudo[111355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-quobyte-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3" acquired by "delete_volume" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cd60df-ade3-4e03-97e1-b7534f92c8b8]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:48 devstack sudo[111357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3 Jun 25 18:23:48 devstack sudo[111357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:48 devstack sudo[111349]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8" returned: 0 in 0.892s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] <== create_volume: return (2367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.370s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.103s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-674142773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2e6b6a-dc99-4443-9e20-330831c8bd28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8f6e1182a4c3ba718cb0f48985497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:46Z,use_quota=True,user_id='66a1b929ac13427da5d52132a8b4cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Creating volume 5b2e6b6a-dc99-4443-9e20-330831c8bd28 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:48 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:48 devstack sudo[111360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28 1073741824 Jun 25 18:23:48 devstack sudo[111360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:48 devstack sudo[111353]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.925s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:48 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Deleted volume successfully. Jun 25 18:23:48 devstack sudo[111355]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06" returned: 1 in 0.912s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Downloaded image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c ((None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}])) to volume 71999656-d1b1-48d3-ac89-111b194d4e06 successfully. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Temporary image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c for user d9a0a4c582b6445dbd0225cc1fe2158b is deleted. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Marking volume 71999656-d1b1-48d3-ac89-111b194d4e06 as bootable. {{(pid=93651) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:23:48 devstack sudo[111357]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3" returned: 0 in 0.846s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:48 devstack sudo[111374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3 Jun 25 18:23:48 devstack sudo[111374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Flow 'volume_create_manager' (55a9e301-f4a5-4753-a99f-0e3e8414297b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21189340-7321-4cde-83b1-62abb5e77b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21189340-7321-4cde-83b1-62abb5e77b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1907569857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6928a78e-eacc-40b1-98b8-14587976eaf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8f6e1182a4c3ba718cb0f48985497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:48Z,use_quota=True,user_id='66a1b929ac13427da5d52132a8b4cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cd103c-9f73-4afb-8bbe-6aa16355ac42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cd103c-9f73-4afb-8bbe-6aa16355ac42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde46bf1-00a8-4db0-b7a4-bca3dde94323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde46bf1-00a8-4db0-b7a4-bca3dde94323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6928a78e-eacc-40b1-98b8-14587976eaf7', 'volume_name': 'volume-6928a78e-eacc-40b1-98b8-14587976eaf7', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6394268d-c15b-48f9-89e9-84fe5ed6933d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6394268d-c15b-48f9-89e9-84fe5ed6933d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701255a3-2c31-4e29-8d4b-06ff87ad11ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:48 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume 6928a78e-eacc-40b1-98b8-14587976eaf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6928a78e-eacc-40b1-98b8-14587976eaf7', 'volume_size': 1} Jun 25 18:23:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:49 devstack sudo[111360]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28 1073741824" returned: 0 in 0.927s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85265083-8635-48d3-a4ba-44964dca59a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:49 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716d5a43-627a-4102-8a32-2eab3f13ae65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:49 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Copying metadata from image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c to 71999656-d1b1-48d3-ac89-111b194d4e06. {{(pid=93651) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:23:49 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Creating volume glance metadata for volume 71999656-d1b1-48d3-ac89-111b194d4e06 backed by image 2834cfdd-f1d3-4acf-a5ec-74a95c79167c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93651) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:23:49 devstack sudo[111374]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3" returned: 0 in 0.655s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b4a43b98-04c5-464a-a422-5afdce5838a3 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-159a7e97-0b25-43b0-9ba8-7fc6668b7535-delete_volume" released by "delete_volume" :: held 5.298s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3" released by "delete_volume" :: held 1.552s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:50 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8 (7ddde5d3-cb05-4c3b-b8c9-537196003ee8): created successfully Jun 25 18:23:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716d5a43-627a-4102-8a32-2eab3f13ae65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Flow 'volume_create_manager' (367db948-c8a3-44ef-919f-86852d9729f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:50 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Created reservations ['707cb5b3-1f8d-45ab-ae42-20b7eea77a17', '7f236312-664a-48c7-8129-21c89afa2492', '045000cd-8ee2-4b86-8ad3-695c56a2c8bf', 'd2c68f72-f1b0-4a03-96fe-1c05bf0db97e'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:50 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-756a5b4f-8d9d-4a0e-a6b3-4ce5c8d902b1 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Created volume successfully. Jun 25 18:23:50 devstack sudo[111378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28 Jun 25 18:23:50 devstack sudo[111378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2b31ce-2733-4d6c-9941-53cebccadfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71999656-d1b1-48d3-ac89-111b194d4e06', 'volume_size': 1, 'image_id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab240da4b4934e58a24c7f836ed62427', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2834cfdd-f1d3-4acf-a5ec-74a95c79167c', 'created_at': datetime.datetime(2026, 6, 25, 15, 58, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 58, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2834cfdd-f1d3-4acf-a5ec-74a95c79167c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fd9c8a-434b-4143-912f-79337ff57f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:50 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Volume volume-71999656-d1b1-48d3-ac89-111b194d4e06 (71999656-d1b1-48d3-ac89-111b194d4e06): created successfully Jun 25 18:23:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fd9c8a-434b-4143-912f-79337ff57f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:50 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Flow 'volume_create_manager' (e2ded5a2-957f-4554-8eb3-4cfdead0cf3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:50 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-5bc5a23c-fc78-488c-8366-ffa0aeb7c561 tempest-VolumesGetTest-1914453881 None] Created volume successfully. Jun 25 18:23:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:51 devstack sudo[111381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:23:51 devstack sudo[111381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Flow 'volume_create_manager' (c794e847-eb85-4e08-a7b1-5c245e9ae034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe23063-8f37-47b5-9a19-1a2ed38badc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-5e94053d-3571-41a0-9b07-730137ade62b-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe23063-8f37-47b5-9a19-1a2ed38badc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1975863335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ddf39c2-937a-4074-aef4-a296b11571e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8f6e1182a4c3ba718cb0f48985497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:51Z,use_quota=True,user_id='66a1b929ac13427da5d52132a8b4cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ed19f3-3f31-42a4-a858-f608672e3357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ed19f3-3f31-42a4-a858-f608672e3357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab0a791-bd3a-4d2e-b88f-cd75dbf39a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab0a791-bd3a-4d2e-b88f-cd75dbf39a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ddf39c2-937a-4074-aef4-a296b11571e8', 'volume_name': 'volume-0ddf39c2-937a-4074-aef4-a296b11571e8', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0fe428-3408-4be0-8eb4-fca72e0593a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0fe428-3408-4be0-8eb4-fca72e0593a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03841541-7af4-4103-b574-014e53484af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:51 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume 0ddf39c2-937a-4074-aef4-a296b11571e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ddf39c2-937a-4074-aef4-a296b11571e8', 'volume_size': 1} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-5e94053d-3571-41a0-9b07-730137ade62b-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-quobyte-5e94053d-3571-41a0-9b07-730137ade62b" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-5e94053d-3571-41a0-9b07-730137ade62b" acquired by "delete_volume" :: waited 0.027s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c47aae-85a9-4d13-b1da-8b16ce3a1ca0]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5e94053d-3571-41a0-9b07-730137ade62b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:51 devstack sudo[111383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5e94053d-3571-41a0-9b07-730137ade62b Jun 25 18:23:51 devstack sudo[111383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Flow 'volume_create_manager' (a3e34639-a338-4cc3-a9e6-32f1740c7208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ff4f67-03f5-49c3-8381-25256c69b247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ff4f67-03f5-49c3-8381-25256c69b247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-619745362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c28aab16-173b-47db-9be5-4859654103d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8f6e1182a4c3ba718cb0f48985497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:51Z,use_quota=True,user_id='66a1b929ac13427da5d52132a8b4cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25858b91-cdf2-48dd-afb0-a80b1c60bd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25858b91-cdf2-48dd-afb0-a80b1c60bd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758a9e2b-114f-430f-adce-926dde624a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758a9e2b-114f-430f-adce-926dde624a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c28aab16-173b-47db-9be5-4859654103d0', 'volume_name': 'volume-c28aab16-173b-47db-9be5-4859654103d0', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2059f8a1-5261-41b9-aaeb-cef6fb219bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2059f8a1-5261-41b9-aaeb-cef6fb219bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cb9558-1727-40e1-b5f8-b48cf53e8e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:51 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume c28aab16-173b-47db-9be5-4859654103d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c28aab16-173b-47db-9be5-4859654103d0', 'volume_size': 1} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:51 devstack sudo[111378]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28" returned: 0 in 1.012s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] <== create_volume: return (3653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.659s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.854s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1907569857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6928a78e-eacc-40b1-98b8-14587976eaf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8f6e1182a4c3ba718cb0f48985497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:48Z,use_quota=True,user_id='66a1b929ac13427da5d52132a8b4cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Creating volume 6928a78e-eacc-40b1-98b8-14587976eaf7 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:51 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6928a78e-eacc-40b1-98b8-14587976eaf7 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:51 devstack sudo[111386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6928a78e-eacc-40b1-98b8-14587976eaf7 1073741824 Jun 25 18:23:51 devstack sudo[111386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1070258e-7dc5-457a-bcdb-8ea98386baa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eca0236-5982-44a2-a2ee-9988530077a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:51 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28 (5b2e6b6a-dc99-4443-9e20-330831c8bd28): created successfully Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eca0236-5982-44a2-a2ee-9988530077a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:51 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Flow 'volume_create_manager' (58a3fcb5-ae8e-47e0-8cb6-03bf4b9273ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:51 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-403ce48a-ef30-482e-8c2f-039c8790439d tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Created volume successfully. Jun 25 18:23:52 devstack sudo[111381]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.035s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:52 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Deleted volume successfully. Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-919cd7da-f8c1-4556-a7a6-7159a4947128 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-a8922374-5d7d-4daa-8b05-b12d2fcdcfd3-delete_volume" released by "delete_volume" :: held 4.370s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:52 devstack sudo[111383]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5e94053d-3571-41a0-9b07-730137ade62b" returned: 0 in 1.039s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5e94053d-3571-41a0-9b07-730137ade62b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:52 devstack sudo[111392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5e94053d-3571-41a0-9b07-730137ade62b Jun 25 18:23:52 devstack sudo[111392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Flow 'volume_create_manager' (c55984cb-157e-4e4c-ba07-4a1ebede69d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20ea23c-191d-40d5-abac-0252d7b8229d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20ea23c-191d-40d5-abac-0252d7b8229d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2050740391',display_name='tempest-VolumesGetTest-Volume-1756980122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b191c9-402c-4b92-901d-7da74a1bf0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55878fcf9964ecab5504e35fe766393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:53Z,use_quota=True,user_id='d9a0a4c582b6445dbd0225cc1fe2158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3be6863-d29e-4ec8-a00f-a27665215b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3be6863-d29e-4ec8-a00f-a27665215b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edcce24a-3bd3-45b0-90dd-f855391b6a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edcce24a-3bd3-45b0-90dd-f855391b6a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b191c9-402c-4b92-901d-7da74a1bf0fd', 'volume_name': 'volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da58ee5-79fd-40be-82a1-0900913cffaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da58ee5-79fd-40be-82a1-0900913cffaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1e530e-8f43-4f0d-9409-0cc13f71351c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:52 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Volume e8b191c9-402c-4b92-901d-7da74a1bf0fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd', 'volume_size': 1} Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:52 devstack sudo[111386]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6928a78e-eacc-40b1-98b8-14587976eaf7 1073741824" returned: 0 in 1.047s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6928a78e-eacc-40b1-98b8-14587976eaf7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:52 devstack sudo[111397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6928a78e-eacc-40b1-98b8-14587976eaf7 Jun 25 18:23:52 devstack sudo[111397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:53 devstack sudo[111392]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5e94053d-3571-41a0-9b07-730137ade62b" returned: 0 in 0.725s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-5e94053d-3571-41a0-9b07-730137ade62b" released by "delete_volume" :: held 1.815s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Created reservations ['4fbb46d4-f274-4c9d-9230-a9e47f9ef92f', '99784e94-3fbf-441b-814a-c13fcca93faa', 'd2df1acc-9d3d-49f0-8cb5-45c78dcb9113', '96b811c0-3cfe-4777-b7ab-bd3e66fdca62'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:53 devstack sudo[111400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:23:53 devstack sudo[111400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-bbe4a813-08c7-45b4-ae52-bd35310fee7d-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-bbe4a813-08c7-45b4-ae52-bd35310fee7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-quobyte-88e5b35b-c9a0-4301-a9c8-d3534b8eb415" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-88e5b35b-c9a0-4301-a9c8-d3534b8eb415" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-quobyte-bbe4a813-08c7-45b4-ae52-bd35310fee7d" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-bbe4a813-08c7-45b4-ae52-bd35310fee7d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Deleting offline snapshot bbe4a813-08c7-45b4-ae52-bd35310fee7d of volume 88e5b35b-c9a0-4301-a9c8-d3534b8eb415 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] snapshot_file for this snap is: volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2af2775-40f9-4396-af51-31337b373acd]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:53 devstack sudo[111397]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6928a78e-eacc-40b1-98b8-14587976eaf7" returned: 0 in 0.692s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.383s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1975863335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ddf39c2-937a-4074-aef4-a296b11571e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8f6e1182a4c3ba718cb0f48985497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:51Z,use_quota=True,user_id='66a1b929ac13427da5d52132a8b4cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Creating volume 0ddf39c2-937a-4074-aef4-a296b11571e8 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:53 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ddf39c2-937a-4074-aef4-a296b11571e8 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:53 devstack sudo[111404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ddf39c2-937a-4074-aef4-a296b11571e8 1073741824 Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701255a3-2c31-4e29-8d4b-06ff87ad11ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6928a78e-eacc-40b1-98b8-14587976eaf7', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:53 devstack sudo[111404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c105a2f0-9a8d-4489-8907-8c24b7a00df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:53 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume volume-6928a78e-eacc-40b1-98b8-14587976eaf7 (6928a78e-eacc-40b1-98b8-14587976eaf7): created successfully Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c105a2f0-9a8d-4489-8907-8c24b7a00df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Flow 'volume_create_manager' (55a9e301-f4a5-4753-a99f-0e3e8414297b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:53 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6bf65900-3078-4575-bab5-b3973ce30d5b tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Created volume successfully. Jun 25 18:23:53 devstack sudo[111403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d Jun 25 18:23:53 devstack sudo[111403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:53 devstack sudo[111400]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.744s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:23:53 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Deleted volume successfully. Jun 25 18:23:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ef538b8a-d9e4-444a-863f-2c5182d95c87 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-5e94053d-3571-41a0-9b07-730137ade62b-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:54 devstack sudo[111403]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d" returned: 0 in 0.883s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:23:54 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[92178f49-7e1f-4dfb-ad15-a2bf75d6780e]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:54 devstack sudo[111404]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ddf39c2-937a-4074-aef4-a296b11571e8 1073741824" returned: 0 in 0.895s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ddf39c2-937a-4074-aef4-a296b11571e8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:54 devstack sudo[111418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ddf39c2-937a-4074-aef4-a296b11571e8 Jun 25 18:23:54 devstack sudo[111418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:54 devstack sudo[111417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 Jun 25 18:23:54 devstack sudo[111417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:55 devstack sudo[111418]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ddf39c2-937a-4074-aef4-a296b11571e8" returned: 0 in 0.723s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.569s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-619745362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c28aab16-173b-47db-9be5-4859654103d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8f6e1182a4c3ba718cb0f48985497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:51Z,use_quota=True,user_id='66a1b929ac13427da5d52132a8b4cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Creating volume c28aab16-173b-47db-9be5-4859654103d0 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:55 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c28aab16-173b-47db-9be5-4859654103d0 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03841541-7af4-4103-b574-014e53484af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ddf39c2-937a-4074-aef4-a296b11571e8', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219eb0d0-a8eb-4fcb-afe0-a118232dc6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:55 devstack sudo[111425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c28aab16-173b-47db-9be5-4859654103d0 1073741824 Jun 25 18:23:55 devstack sudo[111425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:55 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume volume-0ddf39c2-937a-4074-aef4-a296b11571e8 (0ddf39c2-937a-4074-aef4-a296b11571e8): created successfully Jun 25 18:23:55 devstack sudo[111417]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219eb0d0-a8eb-4fcb-afe0-a118232dc6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Flow 'volume_create_manager' (c794e847-eb85-4e08-a7b1-5c245e9ae034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415" returned: 0 in 0.892s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:55 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2eebafe8-0365-44a8-ac86-df2a16067ba8 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Created volume successfully. Jun 25 18:23:55 devstack sudo[111427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d Jun 25 18:23:55 devstack sudo[111427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:56 devstack sudo[111427]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d" returned: 0 in 0.822s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:56 devstack sudo[111436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d Jun 25 18:23:56 devstack sudo[111436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:56 devstack sudo[111425]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c28aab16-173b-47db-9be5-4859654103d0 1073741824" returned: 0 in 1.022s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c28aab16-173b-47db-9be5-4859654103d0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:56 devstack sudo[111438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c28aab16-173b-47db-9be5-4859654103d0 Jun 25 18:23:56 devstack sudo[111438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:56 devstack sudo[111436]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415.bbe4a813-08c7-45b4-ae52-bd35310fee7d" returned: 0 in 0.706s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:56 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-bbe4a813-08c7-45b4-ae52-bd35310fee7d" released by "_delete_snapshot" :: held 3.439s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:56 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-88e5b35b-c9a0-4301-a9c8-d3534b8eb415" released by "delete_snapshot" :: held 3.466s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:56 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Created reservations ['ebceeadf-60a0-4a20-8477-0ec4d305f49f', '1c41255b-16fe-4340-a984-acc05dcb0bf8', '58eb3cf6-1795-40ba-81ad-321b2bac419c', 'd9489b07-ea48-46d9-bcbc-7d71a98fea57'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:57 devstack sudo[111438]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c28aab16-173b-47db-9be5-4859654103d0" returned: 0 in 0.719s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.267s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:23:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2050740391',display_name='tempest-VolumesGetTest-Volume-1756980122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b191c9-402c-4b92-901d-7da74a1bf0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55878fcf9964ecab5504e35fe766393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:23:53Z,use_quota=True,user_id='d9a0a4c582b6445dbd0225cc1fe2158b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Creating volume e8b191c9-402c-4b92-901d-7da74a1bf0fd {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:23:57 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:57 devstack sudo[111442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd 1073741824 Jun 25 18:23:57 devstack sudo[111442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cb9558-1727-40e1-b5f8-b48cf53e8e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c28aab16-173b-47db-9be5-4859654103d0', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c8f55f-43a6-4922-8aeb-7be86d12878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:57 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Delete snapshot completed successfully. Jun 25 18:23:57 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Volume volume-c28aab16-173b-47db-9be5-4859654103d0 (c28aab16-173b-47db-9be5-4859654103d0): created successfully Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c8f55f-43a6-4922-8aeb-7be86d12878e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Flow 'volume_create_manager' (a3e34639-a338-4cc3-a9e6-32f1740c7208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0bfd1b1b-adcf-42d0-899e-615fd86ebaab tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-bbe4a813-08c7-45b4-ae52-bd35310fee7d-delete_snapshot" released by "delete_snapshot" :: held 3.711s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:57 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ab2a3298-4e70-4fcf-941b-be8982961a3c tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Created volume successfully. Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-88e5b35b-c9a0-4301-a9c8-d3534b8eb415-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-88e5b35b-c9a0-4301-a9c8-d3534b8eb415-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "cinder-quobyte-88e5b35b-c9a0-4301-a9c8-d3534b8eb415" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-88e5b35b-c9a0-4301-a9c8-d3534b8eb415" acquired by "delete_volume" :: waited 0.019s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ab0bc2-3b60-4613-ab60-b71f70df9c03]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:57 devstack sudo[111447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 Jun 25 18:23:57 devstack sudo[111447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:58 devstack sudo[111442]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd 1073741824" returned: 0 in 1.011s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:58 devstack sudo[111449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd Jun 25 18:23:58 devstack sudo[111449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "cinder-c28aab16-173b-47db-9be5-4859654103d0-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-c28aab16-173b-47db-9be5-4859654103d0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "cinder-quobyte-c28aab16-173b-47db-9be5-4859654103d0" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-quobyte-c28aab16-173b-47db-9be5-4859654103d0" acquired by "delete_volume" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[63db3121-5660-42c4-90bc-ba62ce39273e]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c28aab16-173b-47db-9be5-4859654103d0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:58 devstack sudo[111452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c28aab16-173b-47db-9be5-4859654103d0 Jun 25 18:23:58 devstack sudo[111452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:58 devstack sudo[111447]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415" returned: 0 in 1.047s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:58 devstack sudo[111449]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd" returned: 0 in 0.775s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:58 devstack sudo[111458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415 Jun 25 18:23:58 devstack sudo[111458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1e530e-8f43-4f0d-9409-0cc13f71351c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fb827f-56a2-43b1-8f7b-a32230e25a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=115,cinder:INSERT=51,cinder:UPDATE=154,cinder:DELETE=11 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:23:58 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Volume volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd (e8b191c9-402c-4b92-901d-7da74a1bf0fd): created successfully Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fb827f-56a2-43b1-8f7b-a32230e25a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:23:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Flow 'volume_create_manager' (c55984cb-157e-4e4c-ba07-4a1ebede69d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:23:58 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-df1c4a46-03b9-4ce4-b7bd-38ec82b2b0a2 tempest-VolumesGetTest-1914453881 None] Created volume successfully. Jun 25 18:23:59 devstack sudo[111452]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c28aab16-173b-47db-9be5-4859654103d0" returned: 0 in 0.855s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c28aab16-173b-47db-9be5-4859654103d0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:59 devstack sudo[111463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c28aab16-173b-47db-9be5-4859654103d0 Jun 25 18:23:59 devstack sudo[111463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:23:59 devstack sudo[111458]: pam_unix(sudo:session): session closed for user root Jun 25 18:23:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-88e5b35b-c9a0-4301-a9c8-d3534b8eb415" returned: 0 in 0.717s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:23:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-quobyte-88e5b35b-c9a0-4301-a9c8-d3534b8eb415" released by "delete_volume" :: held 1.847s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:23:59 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Created reservations ['d3758939-67cd-4e41-a4c2-58c49fe60045', '3f4f4e72-a5de-4e1a-b0c7-32dfb040f6d3', 'd3047c6e-814d-417e-87bb-e73f11ec6498', 'f18aba4d-55ad-4b22-8808-bfe55eaca112'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:23:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:23:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:23:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:23:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:23:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:23:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:23:59 devstack sudo[111466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:23:59 devstack sudo[111466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:00 devstack sudo[111463]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c28aab16-173b-47db-9be5-4859654103d0" returned: 0 in 0.756s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-quobyte-c28aab16-173b-47db-9be5-4859654103d0" released by "delete_volume" :: held 1.670s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Created reservations ['3414fd2b-fd72-4145-a955-37ce68d0b513', '62b4ac0f-3176-4c13-bc2b-0fe786a2f2f2', 'eacba601-fc4f-42d9-a0f0-04ce5d8bece0', '14277b5f-e76c-42c1-bcb4-853afe058c61'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-e8b191c9-402c-4b92-901d-7da74a1bf0fd-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Lock "cinder-e8b191c9-402c-4b92-901d-7da74a1bf0fd-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:00 devstack sudo[111469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:00 devstack sudo[111469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-quobyte-e8b191c9-402c-4b92-901d-7da74a1bf0fd" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-e8b191c9-402c-4b92-901d-7da74a1bf0fd" acquired by "delete_volume" :: waited 0.018s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[a512a1a0-9ac2-4018-a81a-41d3cbf72491]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:00 devstack sudo[111471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd Jun 25 18:24:00 devstack sudo[111471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "cinder-0ddf39c2-937a-4074-aef4-a296b11571e8-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-0ddf39c2-937a-4074-aef4-a296b11571e8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:00 devstack sudo[111466]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.977s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:00 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Deleted volume successfully. Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-731fbf30-d07e-42e7-b886-71a72a1b7ef6 tempest-CreateVolumesFromSnapshotTest-1915020811 None] Lock "cinder-88e5b35b-c9a0-4301-a9c8-d3534b8eb415-delete_volume" released by "delete_volume" :: held 3.106s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "cinder-quobyte-0ddf39c2-937a-4074-aef4-a296b11571e8" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-quobyte-0ddf39c2-937a-4074-aef4-a296b11571e8" acquired by "delete_volume" :: waited 0.025s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cff793e-21c7-40ec-a311-2d35f43b14b4]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ddf39c2-937a-4074-aef4-a296b11571e8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:01 devstack sudo[111474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ddf39c2-937a-4074-aef4-a296b11571e8 Jun 25 18:24:01 devstack sudo[111474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:01 devstack sudo[111469]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.043s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:01 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:01 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Deleted volume successfully. Jun 25 18:24:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2db9cf08-ae91-49ae-b6d4-bb1d7f2447b0 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-c28aab16-173b-47db-9be5-4859654103d0-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:01 devstack sudo[111471]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd" returned: 0 in 1.140s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:01 devstack sudo[111481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd Jun 25 18:24:01 devstack sudo[111481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:02 devstack sudo[111474]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ddf39c2-937a-4074-aef4-a296b11571e8" returned: 0 in 1.146s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ddf39c2-937a-4074-aef4-a296b11571e8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:02 devstack sudo[111486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ddf39c2-937a-4074-aef4-a296b11571e8 Jun 25 18:24:02 devstack sudo[111486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:02 devstack sudo[111481]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-e8b191c9-402c-4b92-901d-7da74a1bf0fd" returned: 0 in 0.815s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-e8b191c9-402c-4b92-901d-7da74a1bf0fd" released by "delete_volume" :: held 2.027s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Created reservations ['a29c7bd5-31b0-420c-879a-91f883820faa', 'b8362d8a-820a-4e4a-8e19-c5c01d543b0f', '701488b8-a3e2-47b1-a031-0665fe5e914c', 'a90e58e8-f373-495a-adc8-c6edd13d0c1c'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:02 devstack sudo[111489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:02 devstack sudo[111489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-71999656-d1b1-48d3-ac89-111b194d4e06-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Lock "cinder-71999656-d1b1-48d3-ac89-111b194d4e06-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Acquiring lock "cinder-quobyte-71999656-d1b1-48d3-ac89-111b194d4e06" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-71999656-d1b1-48d3-ac89-111b194d4e06" acquired by "delete_volume" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:02 devstack sudo[111486]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ddf39c2-937a-4074-aef4-a296b11571e8" returned: 0 in 0.822s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-quobyte-0ddf39c2-937a-4074-aef4-a296b11571e8" released by "delete_volume" :: held 2.055s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df1b1b2-1afd-49b3-b0b1-8fa0153bcd84]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Created reservations ['72b73c8a-1253-4501-a9c7-8283caf67df3', 'd0e37ca3-d87e-444c-8c3a-37c23ed80c14', '459e4a2a-a609-406e-88a8-d304688bd69d', '1f574d27-0e9e-4344-8d8d-22cd9a0f0ca4'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:03 devstack sudo[111492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 Jun 25 18:24:03 devstack sudo[111492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:03 devstack sudo[111494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:03 devstack sudo[111494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:03 devstack sudo[111489]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.859s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:03 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Deleted volume successfully. Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b5489e64-0ef9-43ed-bbde-a62cf64328da tempest-VolumesGetTest-1914453881 None] Lock "cinder-e8b191c9-402c-4b92-901d-7da74a1bf0fd-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:03 devstack sudo[111492]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06" returned: 0 in 0.877s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:03 devstack sudo[111494]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.738s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:03 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Deleted volume successfully. Jun 25 18:24:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ce0d6dc7-6cda-495e-9ae0-8ac60ee63303 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-0ddf39c2-937a-4074-aef4-a296b11571e8-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:03 devstack sudo[111502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 Jun 25 18:24:03 devstack sudo[111502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "cinder-6928a78e-eacc-40b1-98b8-14587976eaf7-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-6928a78e-eacc-40b1-98b8-14587976eaf7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "cinder-quobyte-6928a78e-eacc-40b1-98b8-14587976eaf7" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:04 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-quobyte-6928a78e-eacc-40b1-98b8-14587976eaf7" acquired by "delete_volume" :: waited 0.030s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:04 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e609e0-ce61-41a6-83b8-72e26584174d]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6928a78e-eacc-40b1-98b8-14587976eaf7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:04 devstack sudo[111506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6928a78e-eacc-40b1-98b8-14587976eaf7 Jun 25 18:24:04 devstack sudo[111506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:04 devstack sudo[111502]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06" returned: 1 in 0.968s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:24:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:04 devstack sudo[111511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06 Jun 25 18:24:04 devstack sudo[111511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:05 devstack sudo[111506]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6928a78e-eacc-40b1-98b8-14587976eaf7" returned: 0 in 1.096s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6928a78e-eacc-40b1-98b8-14587976eaf7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:05 devstack sudo[111518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6928a78e-eacc-40b1-98b8-14587976eaf7 Jun 25 18:24:05 devstack sudo[111518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:05 devstack sudo[111511]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-71999656-d1b1-48d3-ac89-111b194d4e06" returned: 0 in 0.864s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Lock "cinder-quobyte-71999656-d1b1-48d3-ac89-111b194d4e06" released by "delete_volume" :: held 2.800s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:05 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Created reservations ['f99ad6ce-20da-4180-a4e4-bf66f3b0206d', 'efe84459-2cbf-4ca8-ab44-ae1c847dedc4', 'c38cbd74-91bc-4957-89bd-5ed1095b4c48', '254d217e-c773-4b79-aae8-289a896595f6'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:05 devstack sudo[111521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:05 devstack sudo[111521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:06 devstack sudo[111518]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6928a78e-eacc-40b1-98b8-14587976eaf7" returned: 0 in 0.864s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-quobyte-6928a78e-eacc-40b1-98b8-14587976eaf7" released by "delete_volume" :: held 2.044s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Created reservations ['e91154e1-a521-4a47-8351-958efdaf9031', '25a27b7a-35e8-4f6a-bcd5-0c5257ee2445', 'f4e54377-2a5c-42a7-bc7d-12237e0930d7', 'c3d918b8-e606-4b85-9717-08d9985e0d11'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:06 devstack sudo[111540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:06 devstack sudo[111540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "cinder-5b2e6b6a-dc99-4443-9e20-330831c8bd28-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-5b2e6b6a-dc99-4443-9e20-330831c8bd28-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "cinder-quobyte-5b2e6b6a-dc99-4443-9e20-330831c8bd28" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-quobyte-5b2e6b6a-dc99-4443-9e20-330831c8bd28" acquired by "delete_volume" :: waited 0.035s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4175e481-e10a-4550-bc6f-b9f9a2a35e91]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:07 devstack sudo[111566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28 Jun 25 18:24:07 devstack sudo[111566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:07 devstack sudo[111521]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.293s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:07 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:07 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Deleted volume successfully. Jun 25 18:24:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-573f1437-cfb6-4f89-8f06-0ae4ece63432 tempest-VolumesGetTest-1914453881 None] Lock "cinder-71999656-d1b1-48d3-ac89-111b194d4e06-delete_volume" released by "delete_volume" :: held 4.413s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:07 devstack sudo[111540]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.227s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:07 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:07 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Deleted volume successfully. Jun 25 18:24:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3f38ce1e-e86e-4de6-90c7-810fe46ed9e3 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-6928a78e-eacc-40b1-98b8-14587976eaf7-delete_volume" released by "delete_volume" :: held 3.720s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:08 devstack sudo[111566]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28" returned: 0 in 1.344s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:08 devstack sudo[111576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28 Jun 25 18:24:08 devstack sudo[111576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Flow 'volume_create_manager' (a73b8d3f-8a67-4dc0-bef5-176c97bd4068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f2fd98-a278-4e22-8591-2828c61d34f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f2fd98-a278-4e22-8591-2828c61d34f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ea8ba4-7319-494c-bbe6-b95f770a0d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc8798b18be4689b29e310da085a601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:08Z,use_quota=True,user_id='29d8848a5d8649729277f63cc9f0e09e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c7e1f3-54c6-4443-acfc-fda04c975e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c7e1f3-54c6-4443-acfc-fda04c975e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d965e29-5d3c-48c2-8e5f-f358fbfc227e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG cinder.image.glance [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Creating Keystone auth plugin from conf {{(pid=93651) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d965e29-5d3c-48c2-8e5f-f358fbfc227e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd1ea8ba4-7319-494c-bbe6-b95f770a0d17', 'volume_name': 'volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17', 'volume_size': 1, 'image_id': '8c5ca021-9178-480d-a160-8ad0f2fa1c9d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c5ca021-9178-480d-a160-8ad0f2fa1c9d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ae9e84d05d8eb00f960c47c0a37a0345', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bdc8798b18be4689b29e310da085a601', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9eae85259ce10588bbd54379f1cf6518234e67cc2d1c5b255829d3612c8c4cc6a9d8cfdc044e391b8879774804cfc117a3c7b560fd2ce1c6666e06f0157a8a39', 'id': '8c5ca021-9178-480d-a160-8ad0f2fa1c9d', 'created_at': datetime.datetime(2026, 6, 25, 16, 24, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 24, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c5ca021-9178-480d-a160-8ad0f2fa1c9d/file', 'properties': {}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6483208b-52ef-40a3-8c7b-e1bdb5fd6f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6483208b-52ef-40a3-8c7b-e1bdb5fd6f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c25e63-53d3-484d-a462-bfd4ec00693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:08 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Volume d1ea8ba4-7319-494c-bbe6-b95f770a0d17: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17', 'volume_size': 1, 'image_id': '8c5ca021-9178-480d-a160-8ad0f2fa1c9d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c5ca021-9178-480d-a160-8ad0f2fa1c9d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ae9e84d05d8eb00f960c47c0a37a0345', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bdc8798b18be4689b29e310da085a601', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9eae85259ce10588bbd54379f1cf6518234e67cc2d1c5b255829d3612c8c4cc6a9d8cfdc044e391b8879774804cfc117a3c7b560fd2ce1c6666e06f0157a8a39', 'id': '8c5ca021-9178-480d-a160-8ad0f2fa1c9d', 'created_at': datetime.datetime(2026, 6, 25, 16, 24, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 24, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c5ca021-9178-480d-a160-8ad0f2fa1c9d/file', 'properties': {}}, 'image_service': } Jun 25 18:24:08 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Trying to clone d1ea8ba4-7319-494c-bbe6-b95f770a0d17 from image 8c5ca021-9178-480d-a160-8ad0f2fa1c9d at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c5ca021-9178-480d-a160-8ad0f2fa1c9d', 'metadata': {}}]). {{(pid=93651) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:24:09 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Image download 0.00 MB at 0.00 MB/s Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1756195-a3bd-4a39-9c57-f1e7f9edc001]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:09 devstack sudo[111576]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5b2e6b6a-dc99-4443-9e20-330831c8bd28" returned: 0 in 0.897s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:09 devstack sudo[111580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD Jun 25 18:24:09 devstack sudo[111580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-quobyte-5b2e6b6a-dc99-4443-9e20-330831c8bd28" released by "delete_volume" :: held 2.336s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Created reservations ['1af4635f-9e72-467f-97f5-c24dfd6c6671', 'd25002ae-07ef-4cf3-b862-dce50ff348f0', '97107662-c963-4a67-8695-794c3c8b3342', '14074a2e-76fd-4503-b9f3-3aff3b68cd57'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:09 devstack sudo[111582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:09 devstack sudo[111582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:09 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-6417a08b-5f14-4663-b2a7-b5fb41c48ecc tempest-TestShelveInstance-1314808157 None] Terminate volume connection completed successfully. Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-6417a08b-5f14-4663-b2a7-b5fb41c48ecc tempest-TestShelveInstance-1314808157 None] Deleting attachment 77dd5cd4-b1d9-46fc-b2c5-09ae97314f1a. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:24:09 devstack sudo[111580]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD" returned: 0 in 0.883s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:10 devstack sudo[111586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD Jun 25 18:24:10 devstack sudo[111586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:10 devstack sudo[111582]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.771s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Deleted volume successfully. Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1dda0ac5-6932-460b-aba5-ebb0d670b4e6 tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-5b2e6b6a-dc99-4443-9e20-330831c8bd28-delete_volume" released by "delete_volume" :: held 3.461s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "cinder-7ddde5d3-cb05-4c3b-b8c9-537196003ee8-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-7ddde5d3-cb05-4c3b-b8c9-537196003ee8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "cinder-quobyte-7ddde5d3-cb05-4c3b-b8c9-537196003ee8" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-quobyte-7ddde5d3-cb05-4c3b-b8c9-537196003ee8" acquired by "delete_volume" :: waited 0.018s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba19a6f0-2bef-49d2-808e-d8818bec8475]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Acquiring lock "cinder-8efdc544-edc8-4ffd-9452-881348c116b8-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Lock "cinder-8efdc544-edc8-4ffd-9452-881348c116b8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Acquiring lock "cinder-quobyte-8efdc544-edc8-4ffd-9452-881348c116b8" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:10 devstack sudo[111589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8 Jun 25 18:24:10 devstack sudo[111589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Lock "cinder-quobyte-8efdc544-edc8-4ffd-9452-881348c116b8" acquired by "delete_volume" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfcb476-8025-48d2-994f-92dfb309a58d]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:10 devstack sudo[111591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 Jun 25 18:24:10 devstack sudo[111591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:10 devstack sudo[111586]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD" returned: 1 in 1.032s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:24:10 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Temporary image 8c5ca021-9178-480d-a160-8ad0f2fa1c9d is fetched for user 29d8848a5d8649729277f63cc9f0e09e. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:24:11 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[990b040e-c8c7-4e0f-8530-40886c9e3de4]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:11 devstack sudo[111596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD Jun 25 18:24:11 devstack sudo[111596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:11 devstack sudo[111589]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8" returned: 0 in 1.140s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:11 devstack sudo[111601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8 Jun 25 18:24:11 devstack sudo[111601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:12 devstack sudo[111591]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8" returned: 0 in 1.264s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:12 devstack sudo[111605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 Jun 25 18:24:12 devstack sudo[111605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:12 devstack sudo[111596]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD" returned: 0 in 1.196s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:12 devstack sudo[111609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD Jun 25 18:24:12 devstack sudo[111609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:12 devstack sudo[111601]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ddde5d3-cb05-4c3b-b8c9-537196003ee8" returned: 0 in 0.862s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:12 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-quobyte-7ddde5d3-cb05-4c3b-b8c9-537196003ee8" released by "delete_volume" :: held 2.076s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:12 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Created reservations ['90ce69b3-9c06-486d-9324-394e598f2d42', 'b3e56c76-9c52-4688-879f-3966d1403d52', 'ed334c48-fa67-471c-851c-15c19e4b33dd', '7d8cb0fc-28df-4da7-b57e-a8419268c049'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:12 devstack sudo[111612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:12 devstack sudo[111612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:13 devstack sudo[111605]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8" returned: 1 in 1.120s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:13 devstack sudo[111617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8 Jun 25 18:24:13 devstack sudo[111617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:13 devstack sudo[111609]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD" returned: 1 in 1.175s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ea8ba4-7319-494c-bbe6-b95f770a0d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc8798b18be4689b29e310da085a601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:08Z,use_quota=True,user_id='29d8848a5d8649729277f63cc9f0e09e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Creating volume d1ea8ba4-7319-494c-bbe6-b95f770a0d17 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:13 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:13 devstack sudo[111622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 1073741824 Jun 25 18:24:13 devstack sudo[111622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:13 devstack sudo[111612]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.809s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:13 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Deleted volume successfully. Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-92740dc9-6488-460e-b78e-334b4062a7cf tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-7ddde5d3-cb05-4c3b-b8c9-537196003ee8-delete_volume" released by "delete_volume" :: held 3.380s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "cinder-97dcc0cd-be17-4700-b1a7-558d60137b8c-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-97dcc0cd-be17-4700-b1a7-558d60137b8c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "cinder-quobyte-97dcc0cd-be17-4700-b1a7-558d60137b8c" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-quobyte-97dcc0cd-be17-4700-b1a7-558d60137b8c" acquired by "delete_volume" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:14 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89f2514-7044-43e1-82f0-80fff0ef11f8]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-97dcc0cd-be17-4700-b1a7-558d60137b8c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:14 devstack sudo[111617]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-8efdc544-edc8-4ffd-9452-881348c116b8" returned: 0 in 0.992s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Lock "cinder-quobyte-8efdc544-edc8-4ffd-9452-881348c116b8" released by "delete_volume" :: held 3.485s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:14 devstack cinder-volume[93651]: DEBUG cinder.quota [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Created reservations ['d8f42bdf-70e5-4b75-ae78-9fed0841ad3e', '164410eb-3fb2-45f2-849c-49d608d1ab32', 'a9fa892c-705f-4731-bbf6-09c931cb3856', '34c6306f-ba93-4f06-8595-27323caee502'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:14 devstack sudo[111626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-97dcc0cd-be17-4700-b1a7-558d60137b8c Jun 25 18:24:14 devstack sudo[111626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:14 devstack sudo[111628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:14 devstack sudo[111628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:15 devstack sudo[111622]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 1073741824" returned: 0 in 1.594s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:15 devstack sudo[111634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 Jun 25 18:24:15 devstack sudo[111634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Flow 'volume_create_manager' (0e9bbe48-da36-4ed2-b69b-880beb25b0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1868e28a-75cb-4f3f-9a34-e4f81abdfd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1868e28a-75cb-4f3f-9a34-e4f81abdfd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1935298207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c670919-76e4-4d7f-b846-ae2aeb2edc0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='166f2198e21948f8a208ea83be6bba3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:15Z,use_quota=True,user_id='79979520e1f0439d9936f9179c74116e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6946b52-0b09-4939-867c-0389dc5dfc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6946b52-0b09-4939-867c-0389dc5dfc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50db10db-7134-40df-96dc-f227d5a87085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50db10db-7134-40df-96dc-f227d5a87085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c670919-76e4-4d7f-b846-ae2aeb2edc0f', 'volume_name': 'volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cacb27d6-81e2-44e6-9a2c-1ad52dbb3c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cacb27d6-81e2-44e6-9a2c-1ad52dbb3c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95514c0f-a24d-48d8-b4c0-142ec43fa959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:15 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Volume 0c670919-76e4-4d7f-b846-ae2aeb2edc0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f', 'volume_size': 1} Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:15 devstack sudo[111628]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.135s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG cinder.manager [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:15 devstack sudo[111626]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-97dcc0cd-be17-4700-b1a7-558d60137b8c" returned: 0 in 1.385s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-97dcc0cd-be17-4700-b1a7-558d60137b8c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:15 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Deleted volume successfully. Jun 25 18:24:15 devstack sudo[111641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-97dcc0cd-be17-4700-b1a7-558d60137b8c Jun 25 18:24:15 devstack sudo[111641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [req-b1b79d16-b39b-48c3-b03a-429e522f377c req-524ce23d-7c38-4453-9b0f-d8fcfae5ad35 tempest-TestShelveInstance-1314808157 None] Lock "cinder-8efdc544-edc8-4ffd-9452-881348c116b8-delete_volume" released by "delete_volume" :: held 4.971s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:16 devstack sudo[111634]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17" returned: 0 in 0.902s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] <== create_volume: return (2570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.577s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.553s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1935298207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c670919-76e4-4d7f-b846-ae2aeb2edc0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='166f2198e21948f8a208ea83be6bba3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:15Z,use_quota=True,user_id='79979520e1f0439d9936f9179c74116e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Creating volume 0c670919-76e4-4d7f-b846-ae2aeb2edc0f {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:16 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:16 devstack sudo[111644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f 1073741824 Jun 25 18:24:16 devstack sudo[111644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Attempting download of 8c5ca021-9178-480d-a160-8ad0f2fa1c9d ((None, [{'url': 'file:///opt/stack/data/glance/images/8c5ca021-9178-480d-a160-8ad0f2fa1c9d', 'metadata': {}}])) to volume d1ea8ba4-7319-494c-bbe6-b95f770a0d17. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[1553e00b-6585-4145-9b31-91697d3bb179]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_yckrbaq3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:16 devstack sudo[111641]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-97dcc0cd-be17-4700-b1a7-558d60137b8c" returned: 0 in 0.816s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:16 devstack sudo[111647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_yckrbaq3 Jun 25 18:24:16 devstack sudo[111647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-quobyte-97dcc0cd-be17-4700-b1a7-558d60137b8c" released by "delete_volume" :: held 2.285s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Created reservations ['b193e74c-f769-4c48-ac14-f715047442ea', 'de893916-7b82-4cb7-b19d-8c7fce4924b4', '094c8edd-5d93-4a60-8081-907afacbf1a1', '53238b5a-1455-47a2-87ec-4655d737109e'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:16 devstack sudo[111649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:16 devstack sudo[111649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:17 devstack sudo[111644]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f 1073741824" returned: 0 in 1.137s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:17 devstack sudo[111647]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_yckrbaq3" returned: 0 in 1.032s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_yckrbaq3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:17 devstack sudo[111660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f Jun 25 18:24:17 devstack sudo[111660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:17 devstack sudo[111658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_yckrbaq3 Jun 25 18:24:17 devstack sudo[111658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:17 devstack sudo[111649]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.936s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:17 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:17 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Deleted volume successfully. Jun 25 18:24:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-995f8adc-f939-4121-867b-49fa5a1e079e tempest-CreateVolumesFromSourceVolumeTest-1968284262 None] Lock "cinder-97dcc0cd-be17-4700-b1a7-558d60137b8c-delete_volume" released by "delete_volume" :: held 3.487s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:18 devstack sudo[111660]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f" returned: 0 in 0.904s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:18 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:18 devstack sudo[111658]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95514c0f-a24d-48d8-b4c0-142ec43fa959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6457c405-2e30-42e3-bb1f-10f859a1f72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_yckrbaq3" returned: 1 in 0.988s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_yckrbaq3' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:24:18 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da1dd37-0c2d-46f5-a89c-57195e2383ec]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:18 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Volume volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f (0c670919-76e4-4d7f-b846-ae2aeb2edc0f): created successfully Jun 25 18:24:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6457c405-2e30-42e3-bb1f-10f859a1f72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Flow 'volume_create_manager' (0e9bbe48-da36-4ed2-b69b-880beb25b0e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:18 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-727db269-3137-4486-88bf-bc68f5124dea tempest-VolumesNegativeTest-871487508 None] Created volume successfully. Jun 25 18:24:18 devstack sudo[111667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD Jun 25 18:24:18 devstack sudo[111667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:19 devstack sudo[111667]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD" returned: 0 in 1.058s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:19 devstack sudo[111671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD Jun 25 18:24:19 devstack sudo[111671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:20 devstack sudo[111671]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD" returned: 1 in 0.984s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:24:20 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] 8c5ca021-9178-480d-a160-8ad0f2fa1c9d was raw, converting to raw {{(pid=93651) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:24:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:20 devstack sudo[111680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 Jun 25 18:24:20 devstack sudo[111680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:21 devstack sudo[111680]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17" returned: 0 in 0.943s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:21 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c5ca021-9178-480d-a160-8ad0f2fa1c9d_dm99qsu0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:24:21 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Converted 0.00 MB image at 0.00 MB/s Jun 25 18:24:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:21 devstack sudo[111686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 1G Jun 25 18:24:21 devstack sudo[111686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:21 devstack sudo[111686]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 1G" returned: 0 in 0.766s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:22 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[95672c75-df39-4e5a-aa5c-e2f63347fd99]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:22 devstack sudo[111691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 Jun 25 18:24:22 devstack sudo[111691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:22 devstack sudo[111691]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17" returned: 0 in 0.903s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:23 devstack sudo[111696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 Jun 25 18:24:23 devstack sudo[111696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:23 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=189,cinder:SELECT=125,cinder:DELETE=17,cinder:INSERT=39 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:24:23 devstack sudo[111696]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17" returned: 1 in 0.937s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:24:23 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Downloaded image 8c5ca021-9178-480d-a160-8ad0f2fa1c9d ((None, [{'url': 'file:///opt/stack/data/glance/images/8c5ca021-9178-480d-a160-8ad0f2fa1c9d', 'metadata': {}}])) to volume d1ea8ba4-7319-494c-bbe6-b95f770a0d17 successfully. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:24:23 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Temporary image 8c5ca021-9178-480d-a160-8ad0f2fa1c9d for user 29d8848a5d8649729277f63cc9f0e09e is deleted. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:24:23 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Marking volume d1ea8ba4-7319-494c-bbe6-b95f770a0d17 as bootable. {{(pid=93651) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:24:23 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Copying metadata from image 8c5ca021-9178-480d-a160-8ad0f2fa1c9d to d1ea8ba4-7319-494c-bbe6-b95f770a0d17. {{(pid=93651) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:24:23 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Creating volume glance metadata for volume d1ea8ba4-7319-494c-bbe6-b95f770a0d17 backed by image 8c5ca021-9178-480d-a160-8ad0f2fa1c9d with: {'image_id': '8c5ca021-9178-480d-a160-8ad0f2fa1c9d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ae9e84d05d8eb00f960c47c0a37a0345', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93651) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:24:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c25e63-53d3-484d-a462-bfd4ec00693b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17', 'volume_size': 1, 'image_id': '8c5ca021-9178-480d-a160-8ad0f2fa1c9d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c5ca021-9178-480d-a160-8ad0f2fa1c9d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ae9e84d05d8eb00f960c47c0a37a0345', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bdc8798b18be4689b29e310da085a601', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9eae85259ce10588bbd54379f1cf6518234e67cc2d1c5b255829d3612c8c4cc6a9d8cfdc044e391b8879774804cfc117a3c7b560fd2ce1c6666e06f0157a8a39', 'id': '8c5ca021-9178-480d-a160-8ad0f2fa1c9d', 'created_at': datetime.datetime(2026, 6, 25, 16, 24, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 24, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c5ca021-9178-480d-a160-8ad0f2fa1c9d/file', 'properties': {}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d81b6e-43d3-414c-a9f3-d4537b257e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:23 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Volume volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 (d1ea8ba4-7319-494c-bbe6-b95f770a0d17): created successfully Jun 25 18:24:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d81b6e-43d3-414c-a9f3-d4537b257e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Flow 'volume_create_manager' (a73b8d3f-8a67-4dc0-bef5-176c97bd4068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:24 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d680633b-01be-4b0f-b5e0-324faeeef821 tempest-VolumeImageDependencyTests-1746087753 None] Created volume successfully. Jun 25 18:24:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Acquiring lock "cinder-d1ea8ba4-7319-494c-bbe6-b95f770a0d17-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Lock "cinder-d1ea8ba4-7319-494c-bbe6-b95f770a0d17-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Acquiring lock "cinder-quobyte-d1ea8ba4-7319-494c-bbe6-b95f770a0d17" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Lock "cinder-quobyte-d1ea8ba4-7319-494c-bbe6-b95f770a0d17" acquired by "delete_volume" :: waited 0.015s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:25 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[846ecb34-0dba-484b-a061-f07857a5d964]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:25 devstack sudo[111702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 Jun 25 18:24:25 devstack sudo[111702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:26 devstack sudo[111702]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17" returned: 0 in 1.058s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:26 devstack sudo[111706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 Jun 25 18:24:26 devstack sudo[111706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:27 devstack sudo[111706]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17" returned: 1 in 1.186s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:24:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:27 devstack sudo[111727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17 Jun 25 18:24:27 devstack sudo[111727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:28 devstack sudo[111727]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d1ea8ba4-7319-494c-bbe6-b95f770a0d17" returned: 0 in 0.759s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Lock "cinder-quobyte-d1ea8ba4-7319-494c-bbe6-b95f770a0d17" released by "delete_volume" :: held 3.092s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:28 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Created reservations ['cd29a171-06dc-468e-8f90-0ec7a8e6330d', '93144d0b-eca9-40d4-af20-76f02959b0b2', '0af46071-5d22-442a-aecb-94dc8a1e79ca', '9857eebc-240e-4046-83bb-57b576f6ffd5'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:28 devstack sudo[111732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:28 devstack sudo[111732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:29 devstack sudo[111732]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.735s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:29 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Deleted volume successfully. Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4cdf3780-c032-4e37-b777-cd4ef777da33 tempest-VolumeImageDependencyTests-1746087753 None] Lock "cinder-d1ea8ba4-7319-494c-bbe6-b95f770a0d17-delete_volume" released by "delete_volume" :: held 4.098s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Flow 'volume_create_manager' (63b4098d-60f5-4c3b-958e-23a2d22a7db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cacb361c-b367-42e0-9de8-b30650e332bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cacb361c-b367-42e0-9de8-b30650e332bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1228389921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea91288-4255-4f65-aa6b-a778cb20ab4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6752a7fb386f49f0a58154a0bd86bf9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:30Z,use_quota=True,user_id='7a26d5774cd94b3887fe75bf96a30172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5005f8f0-0d65-4838-bc57-cc862223604f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5005f8f0-0d65-4838-bc57-cc862223604f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19191ea-c486-4265-ac81-454a148d3ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19191ea-c486-4265-ac81-454a148d3ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea91288-4255-4f65-aa6b-a778cb20ab4a', 'volume_name': 'volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adc17e8-4c81-45f4-9453-ca1f2f40547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adc17e8-4c81-45f4-9453-ca1f2f40547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7872a653-5a71-49b9-b137-13555f6ee41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:29 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Volume 7ea91288-4255-4f65-aa6b-a778cb20ab4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a', 'volume_size': 1} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1228389921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea91288-4255-4f65-aa6b-a778cb20ab4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6752a7fb386f49f0a58154a0bd86bf9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:30Z,use_quota=True,user_id='7a26d5774cd94b3887fe75bf96a30172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Creating volume 7ea91288-4255-4f65-aa6b-a778cb20ab4a {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:29 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:24:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:29 devstack sudo[111769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a 1073741824 Jun 25 18:24:29 devstack sudo[111769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Flow 'volume_create_manager' (a60a1c1c-2d70-40cd-935d-a7ac28c4c556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01192bd6-2861-4fb8-bfe8-5c103bba264d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01192bd6-2861-4fb8-bfe8-5c103bba264d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-843008285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41315abd-5de9-4b3d-93bd-fc0bf6389bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6752a7fb386f49f0a58154a0bd86bf9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:30Z,use_quota=True,user_id='7a26d5774cd94b3887fe75bf96a30172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d01b0e-6ba1-439a-8a7c-60f0c76589a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d01b0e-6ba1-439a-8a7c-60f0c76589a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828f25d9-f806-4a60-8056-6669973e7547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828f25d9-f806-4a60-8056-6669973e7547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41315abd-5de9-4b3d-93bd-fc0bf6389bc7', 'volume_name': 'volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db68d66a-ca7e-409c-b2d1-a4c73aa46481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db68d66a-ca7e-409c-b2d1-a4c73aa46481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8b9040-7657-4059-93a4-a6e453fa3c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:30 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Volume 41315abd-5de9-4b3d-93bd-fc0bf6389bc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7', 'volume_size': 1} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Flow 'volume_create_manager' (f4ffbd54-3338-4acf-9bc5-f7e75c793ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fa033e-0340-4f6c-8da2-d71453065975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fa033e-0340-4f6c-8da2-d71453065975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-454936565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e227553-4ac7-46b3-a42b-03e97aa7a29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6752a7fb386f49f0a58154a0bd86bf9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:31Z,use_quota=True,user_id='7a26d5774cd94b3887fe75bf96a30172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b7c669-a9b4-40f2-809b-c7f759b96eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b7c669-a9b4-40f2-809b-c7f759b96eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532b79ca-51fd-4fd5-bc5e-bdeb3eff0cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532b79ca-51fd-4fd5-bc5e-bdeb3eff0cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e227553-4ac7-46b3-a42b-03e97aa7a29c', 'volume_name': 'volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6331cdc-5c4b-43bd-85e0-b55cabe2f02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6331cdc-5c4b-43bd-85e0-b55cabe2f02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07f7d52-c2fe-43ed-8314-b2033dcd5ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:31 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Volume 1e227553-4ac7-46b3-a42b-03e97aa7a29c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c', 'volume_size': 1} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:31 devstack sudo[111769]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a 1073741824" returned: 0 in 1.431s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:31 devstack sudo[111779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a Jun 25 18:24:31 devstack sudo[111779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Flow 'volume_create_manager' (0c095ab1-3e6b-441f-8efe-b137f06bff28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459d0d0c-d218-4b88-8b5c-11561aabe8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459d0d0c-d218-4b88-8b5c-11561aabe8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1372963777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42391285-e796-48f6-930e-49b88d12e08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6752a7fb386f49f0a58154a0bd86bf9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:32Z,use_quota=True,user_id='7a26d5774cd94b3887fe75bf96a30172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5851b10a-25ac-4075-9d4a-8eee074fb2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5851b10a-25ac-4075-9d4a-8eee074fb2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ecd5ca-9926-4b61-9501-0335f39f01e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ecd5ca-9926-4b61-9501-0335f39f01e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42391285-e796-48f6-930e-49b88d12e08c', 'volume_name': 'volume-42391285-e796-48f6-930e-49b88d12e08c', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d96b06-2c29-45b0-b4fa-b220e184d689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d96b06-2c29-45b0-b4fa-b220e184d689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48fe79c-5939-4329-a487-188be612c529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:31 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Volume 42391285-e796-48f6-930e-49b88d12e08c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42391285-e796-48f6-930e-49b88d12e08c', 'volume_size': 1} Jun 25 18:24:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Flow 'volume_create_manager' (43fdf5e1-c4f9-4c2c-bc86-255d47c40a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37bdc879-a1e5-4bca-9856-ab70457e6d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37bdc879-a1e5-4bca-9856-ab70457e6d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1562089650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f607cfbe-709d-46be-80ec-99971b935f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6752a7fb386f49f0a58154a0bd86bf9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:32Z,use_quota=True,user_id='7a26d5774cd94b3887fe75bf96a30172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da72a0d0-dd70-4db6-9043-7f9c93a3238a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da72a0d0-dd70-4db6-9043-7f9c93a3238a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b274d895-4c2b-4b76-a9c3-3f12c4144abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b274d895-4c2b-4b76-a9c3-3f12c4144abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f607cfbe-709d-46be-80ec-99971b935f19', 'volume_name': 'volume-f607cfbe-709d-46be-80ec-99971b935f19', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e9574c-0340-47c1-a60c-5eaff3f3a1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e9574c-0340-47c1-a60c-5eaff3f3a1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dcf1870-600a-44b3-89ca-976174d7b4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:32 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Volume f607cfbe-709d-46be-80ec-99971b935f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f607cfbe-709d-46be-80ec-99971b935f19', 'volume_size': 1} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:32 devstack sudo[111779]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a" returned: 0 in 0.910s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] <== create_volume: return (2424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.428s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.690s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-843008285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41315abd-5de9-4b3d-93bd-fc0bf6389bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6752a7fb386f49f0a58154a0bd86bf9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:30Z,use_quota=True,user_id='7a26d5774cd94b3887fe75bf96a30172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Creating volume 41315abd-5de9-4b3d-93bd-fc0bf6389bc7 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:32 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:32 devstack sudo[111785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7 1073741824 Jun 25 18:24:32 devstack sudo[111785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7872a653-5a71-49b9-b137-13555f6ee41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6955fd9-0b65-457a-afca-7aa7fef2d07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:32 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Volume volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a (7ea91288-4255-4f65-aa6b-a778cb20ab4a): created successfully Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6955fd9-0b65-457a-afca-7aa7fef2d07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Flow 'volume_create_manager' (63b4098d-60f5-4c3b-958e-23a2d22a7db2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:32 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6ddc62d8-4583-4fb3-86ea-f689d4dc0daa tempest-CreateVolumesFromImageTest-799186453 None] Created volume successfully. Jun 25 18:24:33 devstack sudo[111785]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7 1073741824" returned: 0 in 0.972s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:33 devstack sudo[111791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7 Jun 25 18:24:33 devstack sudo[111791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:33 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Flow 'volume_create_manager' (5abc69e7-d8b2-46a2-88e6-53b4f761eb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599722bd-03a7-4bae-804e-c338a291e3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599722bd-03a7-4bae-804e-c338a291e3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a43a62-ebc8-40ba-8452-c06b83be4df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53835ce967a0414bac9bd3939243016c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:34Z,use_quota=True,user_id='092940e0667e468a8442a41af6f87474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c940336-b262-42f0-bef9-f4f9d4951df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c940336-b262-42f0-bef9-f4f9d4951df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00092580-57d2-48c6-b409-0a6b99dbcec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00092580-57d2-48c6-b409-0a6b99dbcec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73a43a62-ebc8-40ba-8452-c06b83be4df3', 'volume_name': 'volume-73a43a62-ebc8-40ba-8452-c06b83be4df3', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99bdba50-f31e-42a6-9414-605c6521ffe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99bdba50-f31e-42a6-9414-605c6521ffe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:33 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a2c0a4-9e9a-4b58-be86-c851bfe4a425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:33 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Volume 73a43a62-ebc8-40ba-8452-c06b83be4df3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73a43a62-ebc8-40ba-8452-c06b83be4df3', 'volume_size': 1} Jun 25 18:24:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:33 devstack sudo[111791]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7" returned: 0 in 0.775s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.985s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-454936565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e227553-4ac7-46b3-a42b-03e97aa7a29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6752a7fb386f49f0a58154a0bd86bf9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:31Z,use_quota=True,user_id='7a26d5774cd94b3887fe75bf96a30172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Creating volume 1e227553-4ac7-46b3-a42b-03e97aa7a29c {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:34 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8b9040-7657-4059-93a4-a6e453fa3c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:34 devstack sudo[111806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c 1073741824 Jun 25 18:24:34 devstack sudo[111806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f204a49e-f182-473f-aad3-df7d074eac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:34 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Volume volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7 (41315abd-5de9-4b3d-93bd-fc0bf6389bc7): created successfully Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f204a49e-f182-473f-aad3-df7d074eac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Flow 'volume_create_manager' (a60a1c1c-2d70-40cd-935d-a7ac28c4c556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:34 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ec127af4-7919-4d41-9b6e-84a1a9971840 tempest-CreateVolumesFromImageTest-799186453 None] Created volume successfully. Jun 25 18:24:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c 1073741824" returned: 0 in 1.440s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:35 devstack sudo[111806]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:35 devstack sudo[111879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c Jun 25 18:24:35 devstack sudo[111879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:36 devstack sudo[111879]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c" returned: 0 in 0.712s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] <== create_volume: return (2214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.404s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1372963777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42391285-e796-48f6-930e-49b88d12e08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6752a7fb386f49f0a58154a0bd86bf9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:32Z,use_quota=True,user_id='7a26d5774cd94b3887fe75bf96a30172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Creating volume 42391285-e796-48f6-930e-49b88d12e08c {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:36 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-42391285-e796-48f6-930e-49b88d12e08c 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:36 devstack sudo[111884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-42391285-e796-48f6-930e-49b88d12e08c 1073741824 Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07f7d52-c2fe-43ed-8314-b2033dcd5ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:36 devstack sudo[111884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af71850-9e07-4f29-aab7-8e36a6a4ddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:36 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Volume volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c (1e227553-4ac7-46b3-a42b-03e97aa7a29c): created successfully Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af71850-9e07-4f29-aab7-8e36a6a4ddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Flow 'volume_create_manager' (f4ffbd54-3338-4acf-9bc5-f7e75c793ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:36 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-08a43db0-95be-483b-be86-c3fcad6749e8 tempest-CreateVolumesFromImageTest-799186453 None] Created volume successfully. Jun 25 18:24:37 devstack sudo[111884]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-42391285-e796-48f6-930e-49b88d12e08c 1073741824" returned: 0 in 1.102s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-42391285-e796-48f6-930e-49b88d12e08c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:37 devstack sudo[111889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-42391285-e796-48f6-930e-49b88d12e08c Jun 25 18:24:37 devstack sudo[111889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:38 devstack sudo[111889]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-42391285-e796-48f6-930e-49b88d12e08c" returned: 0 in 0.861s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.078s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1562089650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f607cfbe-709d-46be-80ec-99971b935f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6752a7fb386f49f0a58154a0bd86bf9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:32Z,use_quota=True,user_id='7a26d5774cd94b3887fe75bf96a30172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Creating volume f607cfbe-709d-46be-80ec-99971b935f19 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:38 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f607cfbe-709d-46be-80ec-99971b935f19 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:38 devstack sudo[111893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f607cfbe-709d-46be-80ec-99971b935f19 1073741824 Jun 25 18:24:38 devstack sudo[111893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48fe79c-5939-4329-a487-188be612c529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42391285-e796-48f6-930e-49b88d12e08c', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad0d51e-6187-464e-bbc1-8ff5fe8f277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:38 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Volume volume-42391285-e796-48f6-930e-49b88d12e08c (42391285-e796-48f6-930e-49b88d12e08c): created successfully Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad0d51e-6187-464e-bbc1-8ff5fe8f277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:38 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Flow 'volume_create_manager' (0c095ab1-3e6b-441f-8efe-b137f06bff28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:38 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-fcb7cb00-1f81-4850-a8d4-edc251df820c tempest-CreateVolumesFromImageTest-799186453 None] Created volume successfully. Jun 25 18:24:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:24:39 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 28 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:24:39 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:24:39 devstack sudo[111893]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f607cfbe-709d-46be-80ec-99971b935f19 1073741824" returned: 0 in 1.123s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f607cfbe-709d-46be-80ec-99971b935f19 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:39 devstack sudo[111905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f607cfbe-709d-46be-80ec-99971b935f19 Jun 25 18:24:39 devstack sudo[111905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:40 devstack sudo[111905]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f607cfbe-709d-46be-80ec-99971b935f19" returned: 0 in 0.912s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.131s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.679s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a43a62-ebc8-40ba-8452-c06b83be4df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53835ce967a0414bac9bd3939243016c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:34Z,use_quota=True,user_id='092940e0667e468a8442a41af6f87474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Creating volume 73a43a62-ebc8-40ba-8452-c06b83be4df3 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:40 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-73a43a62-ebc8-40ba-8452-c06b83be4df3 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dcf1870-600a-44b3-89ca-976174d7b4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f607cfbe-709d-46be-80ec-99971b935f19', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:40 devstack sudo[111944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-73a43a62-ebc8-40ba-8452-c06b83be4df3 1073741824 Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132c285d-b769-458c-9f8f-5b0f683b5d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:40 devstack sudo[111944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:40 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Volume volume-f607cfbe-709d-46be-80ec-99971b935f19 (f607cfbe-709d-46be-80ec-99971b935f19): created successfully Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132c285d-b769-458c-9f8f-5b0f683b5d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Flow 'volume_create_manager' (43fdf5e1-c4f9-4c2c-bc86-255d47c40a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:40 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-a2e86779-a5c3-439f-a69b-ea94b0008676 tempest-CreateVolumesFromImageTest-799186453 None] Created volume successfully. Jun 25 18:24:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "cinder-f607cfbe-709d-46be-80ec-99971b935f19-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-f607cfbe-709d-46be-80ec-99971b935f19-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "cinder-quobyte-f607cfbe-709d-46be-80ec-99971b935f19" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-quobyte-f607cfbe-709d-46be-80ec-99971b935f19" acquired by "delete_volume" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:41 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e9ad8b-f76e-4f17-95db-6ce07e4bf37b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f607cfbe-709d-46be-80ec-99971b935f19 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:41 devstack sudo[111950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f607cfbe-709d-46be-80ec-99971b935f19 Jun 25 18:24:41 devstack sudo[111950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:41 devstack sudo[111944]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-73a43a62-ebc8-40ba-8452-c06b83be4df3 1073741824" returned: 0 in 1.138s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-73a43a62-ebc8-40ba-8452-c06b83be4df3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:41 devstack sudo[111952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-73a43a62-ebc8-40ba-8452-c06b83be4df3 Jun 25 18:24:41 devstack sudo[111952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:42 devstack sudo[111950]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f607cfbe-709d-46be-80ec-99971b935f19" returned: 0 in 0.921s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f607cfbe-709d-46be-80ec-99971b935f19 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:42 devstack sudo[111958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f607cfbe-709d-46be-80ec-99971b935f19 Jun 25 18:24:42 devstack sudo[111958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:42 devstack sudo[111952]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-73a43a62-ebc8-40ba-8452-c06b83be4df3" returned: 0 in 0.736s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:42 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a2c0a4-9e9a-4b58-be86-c851bfe4a425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a43a62-ebc8-40ba-8452-c06b83be4df3', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbe276f-3997-4006-b264-87e4d5b019fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:42 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Volume volume-73a43a62-ebc8-40ba-8452-c06b83be4df3 (73a43a62-ebc8-40ba-8452-c06b83be4df3): created successfully Jun 25 18:24:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbe276f-3997-4006-b264-87e4d5b019fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:42 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Flow 'volume_create_manager' (5abc69e7-d8b2-46a2-88e6-53b4f761eb4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:42 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d52df034-717f-4fcb-abe1-0ce1b21fbd59 tempest-CinderUnicodeTest-81121524 None] Created volume successfully. Jun 25 18:24:42 devstack sudo[111958]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-f607cfbe-709d-46be-80ec-99971b935f19" returned: 0 in 0.749s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-quobyte-f607cfbe-709d-46be-80ec-99971b935f19" released by "delete_volume" :: held 1.730s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:42 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Created reservations ['ed0689c9-3ad6-466e-8421-d4d6277b7721', 'ac511dcc-fc6f-4876-8da8-c6b7de6da81c', '79fb4c8d-025e-4657-929c-bd8166cb94b1', 'f5bc95e4-fe9a-47bb-a86c-a53926bd28c1'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:43 devstack sudo[111962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:43 devstack sudo[111962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "cinder-42391285-e796-48f6-930e-49b88d12e08c-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-42391285-e796-48f6-930e-49b88d12e08c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "cinder-quobyte-42391285-e796-48f6-930e-49b88d12e08c" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-quobyte-42391285-e796-48f6-930e-49b88d12e08c" acquired by "delete_volume" :: waited 0.029s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d40d792-6d9f-4711-98b9-a5544a86a268]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-42391285-e796-48f6-930e-49b88d12e08c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:43 devstack sudo[111964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-42391285-e796-48f6-930e-49b88d12e08c Jun 25 18:24:43 devstack sudo[111964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:43 devstack sudo[111962]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.821s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:43 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Deleted volume successfully. Jun 25 18:24:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-69cc3a75-4344-4b83-9985-25a49bf6c07b tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-f607cfbe-709d-46be-80ec-99971b935f19-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Flow 'volume_create_manager' (b8a3e68a-9fad-436a-aaca-cd992a0baefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be17b2e8-2629-4f67-9080-763187abb757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be17b2e8-2629-4f67-9080-763187abb757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-845137725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce9524e-bc47-45fc-be59-d8ff9afb152b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53835ce967a0414bac9bd3939243016c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:44Z,use_quota=True,user_id='092940e0667e468a8442a41af6f87474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cdfb920-b8ba-42b2-bfd2-d6e306c1ee86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cdfb920-b8ba-42b2-bfd2-d6e306c1ee86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b5ce8b-77e8-48e8-8c71-c2c2fb1b107a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b5ce8b-77e8-48e8-8c71-c2c2fb1b107a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce9524e-bc47-45fc-be59-d8ff9afb152b', 'volume_name': 'volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f78708-fc98-41f5-978e-9ebcf64bd2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f78708-fc98-41f5-978e-9ebcf64bd2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b311e803-e4f7-492e-acfc-421e068cb6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:44 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Volume 9ce9524e-bc47-45fc-be59-d8ff9afb152b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b', 'volume_size': 1} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-845137725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce9524e-bc47-45fc-be59-d8ff9afb152b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53835ce967a0414bac9bd3939243016c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:44Z,use_quota=True,user_id='092940e0667e468a8442a41af6f87474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Creating volume 9ce9524e-bc47-45fc-be59-d8ff9afb152b {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:44 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:44 devstack sudo[111967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b 1073741824 Jun 25 18:24:44 devstack sudo[111967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:44 devstack sudo[111964]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-42391285-e796-48f6-930e-49b88d12e08c" returned: 0 in 0.984s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-42391285-e796-48f6-930e-49b88d12e08c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:44 devstack sudo[111972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-42391285-e796-48f6-930e-49b88d12e08c Jun 25 18:24:44 devstack sudo[111972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:44 devstack sudo[111967]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b 1073741824" returned: 0 in 0.875s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:45 devstack sudo[111977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b Jun 25 18:24:45 devstack sudo[111977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:45 devstack sudo[111972]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-42391285-e796-48f6-930e-49b88d12e08c" returned: 0 in 0.692s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-quobyte-42391285-e796-48f6-930e-49b88d12e08c" released by "delete_volume" :: held 1.732s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Created reservations ['465f584d-951a-43d1-ac74-892f51ca29ec', '0e7a48df-1ebd-4391-9ad6-3a4abd931f1b', 'fc298852-9477-440d-8b4e-08789687c4e2', 'c40c6419-68c7-4704-8ad4-32b897397f65'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:45 devstack sudo[111980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:45 devstack sudo[111980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "cinder-1e227553-4ac7-46b3-a42b-03e97aa7a29c-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-1e227553-4ac7-46b3-a42b-03e97aa7a29c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:45 devstack sudo[111977]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b" returned: 0 in 0.717s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b311e803-e4f7-492e-acfc-421e068cb6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cf8307-54bd-4d90-ba0e-528cbca0b3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "cinder-quobyte-1e227553-4ac7-46b3-a42b-03e97aa7a29c" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:45 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Volume volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b (9ce9524e-bc47-45fc-be59-d8ff9afb152b): created successfully Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cf8307-54bd-4d90-ba0e-528cbca0b3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Flow 'volume_create_manager' (b8a3e68a-9fad-436a-aaca-cd992a0baefe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-quobyte-1e227553-4ac7-46b3-a42b-03e97aa7a29c" acquired by "delete_volume" :: waited 0.038s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:45 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-fbdb8a39-626a-430e-8639-b3b44f4702e0 tempest-CinderUnicodeTest-81121524 None] Created volume successfully. Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[139b17c5-e149-4d8e-8ee5-a0519ebef5f3]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:46 devstack sudo[111984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c Jun 25 18:24:46 devstack sudo[111984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:46 devstack sudo[111980]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.806s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:46 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:46 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Deleted volume successfully. Jun 25 18:24:46 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ed15fe22-4e78-46f0-8dda-f1ebc11547df tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-42391285-e796-48f6-930e-49b88d12e08c-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] Creating offline snapshot db118237-cd66-404a-a73f-1b84ba7c73cb of volume 9ce9524e-bc47-45fc-be59-d8ff9afb152b {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:24:46 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cc31eb-e729-48ab-8f8a-ef5c0765a48c]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:46 devstack sudo[111987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b Jun 25 18:24:46 devstack sudo[111987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:46 devstack sudo[111984]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c" returned: 0 in 0.959s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:46 devstack sudo[111998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c Jun 25 18:24:46 devstack sudo[111998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:47 devstack sudo[111987]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b" returned: 0 in 0.883s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:47 devstack sudo[112003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb 1G Jun 25 18:24:47 devstack sudo[112003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:47 devstack sudo[111998]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1e227553-4ac7-46b3-a42b-03e97aa7a29c" returned: 0 in 0.724s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-quobyte-1e227553-4ac7-46b3-a42b-03e97aa7a29c" released by "delete_volume" :: held 1.738s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:47 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Created reservations ['e6fc7067-da8f-4527-a94b-3c511a48abb8', 'c887760e-b529-4934-b5b2-3ab3246a9ccc', '46770b83-260d-4c85-98ec-5f41884a53f5', 'ac655443-0b7d-435d-9866-b06e171d4933'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:47 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:47 devstack sudo[112006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:47 devstack sudo[112006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:48 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "cinder-41315abd-5de9-4b3d-93bd-fc0bf6389bc7-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:48 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-41315abd-5de9-4b3d-93bd-fc0bf6389bc7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:48 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "cinder-quobyte-41315abd-5de9-4b3d-93bd-fc0bf6389bc7" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:48 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-quobyte-41315abd-5de9-4b3d-93bd-fc0bf6389bc7" acquired by "delete_volume" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:48 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aecb0d-d18b-4b89-9689-12215553c38a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:48 devstack sudo[112013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7 Jun 25 18:24:48 devstack sudo[112013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:48 devstack sudo[112003]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb 1G" returned: 0 in 0.964s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:48 devstack sudo[112016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb Jun 25 18:24:48 devstack sudo[112016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:48 devstack sudo[112006]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.824s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:48 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:48 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Deleted volume successfully. Jun 25 18:24:48 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-100e3be7-d994-4cb3-9935-d820469b50a1 tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-1e227553-4ac7-46b3-a42b-03e97aa7a29c-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:49 devstack sudo[112013]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7" returned: 0 in 0.895s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:49 devstack sudo[112026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7 Jun 25 18:24:49 devstack sudo[112026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:49 devstack sudo[112016]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb" returned: 0 in 0.908s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:49 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb is being set with open permissions: ugo+rw Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:49 devstack sudo[112030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb Jun 25 18:24:49 devstack sudo[112030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:49 devstack sudo[112026]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-41315abd-5de9-4b3d-93bd-fc0bf6389bc7" returned: 0 in 0.690s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-quobyte-41315abd-5de9-4b3d-93bd-fc0bf6389bc7" released by "delete_volume" :: held 1.636s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Created reservations ['21dab573-c52d-4073-a57a-a863ae46b056', 'bbcc9ebf-bac1-4901-ae97-5fe13ce057cb', 'd939557c-de2a-4fa8-9f15-b38c2d1c1510', '6eaf4a5c-5893-45d6-8737-81147a848c42'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:49 devstack sudo[112030]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb" returned: 0 in 0.742s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:49 devstack sudo[112034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:49 devstack sudo[112034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:50 devstack sudo[112036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.info Jun 25 18:24:50 devstack sudo[112036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "cinder-7ea91288-4255-4f65-aa6b-a778cb20ab4a-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-7ea91288-4255-4f65-aa6b-a778cb20ab4a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "cinder-quobyte-7ea91288-4255-4f65-aa6b-a778cb20ab4a" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-quobyte-7ea91288-4255-4f65-aa6b-a778cb20ab4a" acquired by "delete_volume" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:50 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df256eb-0b0c-4c48-8329-4d18477142af]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:50 devstack sudo[112038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a Jun 25 18:24:50 devstack sudo[112038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:50 devstack sudo[112034]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.822s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:50 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:50 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Deleted volume successfully. Jun 25 18:24:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-39da0564-4327-44d3-8c10-0256ac230ce3 tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-41315abd-5de9-4b3d-93bd-fc0bf6389bc7-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:50 devstack sudo[112036]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.info" returned: 0 in 0.934s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:50 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.info is being set with open permissions: ugo+rw Jun 25 18:24:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:50 devstack sudo[112043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.info Jun 25 18:24:50 devstack sudo[112043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:51 devstack sudo[112038]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a" returned: 0 in 0.887s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:51 devstack sudo[112048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a Jun 25 18:24:51 devstack sudo[112048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:51 devstack sudo[112043]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.info" returned: 0 in 0.754s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.313s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:51 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-dde8975c-8b81-4422-98e8-afa1158784e4 tempest-CinderUnicodeTest-81121524 None] Create snapshot completed successfully Jun 25 18:24:52 devstack sudo[112048]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-7ea91288-4255-4f65-aa6b-a778cb20ab4a" returned: 0 in 0.714s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-quobyte-7ea91288-4255-4f65-aa6b-a778cb20ab4a" released by "delete_volume" :: held 1.658s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Created reservations ['62eef829-6341-4d8e-a7d6-0833689aa619', 'f6e5c0c8-d7ce-4415-87ed-5dd4361326a8', '6f92f19c-6ac7-41c2-89d7-193106591783', '54bcf0d7-fcf4-4a7a-a025-e43cd7128724'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:52 devstack sudo[112052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:52 devstack sudo[112052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Acquiring lock "cinder-0c670919-76e4-4d7f-b846-ae2aeb2edc0f-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Acquiring lock "cinder-db118237-cd66-404a-a73f-1b84ba7c73cb-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Lock "cinder-0c670919-76e4-4d7f-b846-ae2aeb2edc0f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Lock "cinder-db118237-cd66-404a-a73f-1b84ba7c73cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Acquiring lock "cinder-quobyte-9ce9524e-bc47-45fc-be59-d8ff9afb152b" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Lock "cinder-quobyte-9ce9524e-bc47-45fc-be59-d8ff9afb152b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Acquiring lock "cinder-quobyte-db118237-cd66-404a-a73f-1b84ba7c73cb" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Lock "cinder-quobyte-db118237-cd66-404a-a73f-1b84ba7c73cb" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Deleting offline snapshot db118237-cd66-404a-a73f-1b84ba7c73cb of volume 9ce9524e-bc47-45fc-be59-d8ff9afb152b {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] snapshot_file for this snap is: volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Acquiring lock "cinder-quobyte-0c670919-76e4-4d7f-b846-ae2aeb2edc0f" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Lock "cinder-quobyte-0c670919-76e4-4d7f-b846-ae2aeb2edc0f" acquired by "delete_volume" :: waited 0.016s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc33f833-d789-4168-bcb3-4bda0b8bf907]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a98b7b8-5f43-4882-9c1c-ae834616f5c3]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:53 devstack sudo[112054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb Jun 25 18:24:53 devstack sudo[112054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:53 devstack sudo[112052]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:53 devstack sudo[112056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f Jun 25 18:24:53 devstack sudo[112056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.858s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:53 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:53 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Deleted volume successfully. Jun 25 18:24:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-f67b5a06-4505-4b05-811e-4ddb6915b266 tempest-CreateVolumesFromImageTest-799186453 None] Lock "cinder-7ea91288-4255-4f65-aa6b-a778cb20ab4a-delete_volume" released by "delete_volume" :: held 2.777s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:53 devstack sudo[112054]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb" returned: 0 in 0.904s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:24:53 devstack sudo[112056]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f" returned: 0 in 0.928s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:53 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a9e71c-f22e-4cf6-9b7b-0db8524bc44b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:53 devstack sudo[112065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f Jun 25 18:24:53 devstack sudo[112065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:54 devstack sudo[112066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b Jun 25 18:24:54 devstack sudo[112066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:54 devstack sudo[112065]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0c670919-76e4-4d7f-b846-ae2aeb2edc0f" returned: 0 in 0.716s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:54 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Lock "cinder-quobyte-0c670919-76e4-4d7f-b846-ae2aeb2edc0f" released by "delete_volume" :: held 1.692s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:54 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Created reservations ['2f8edab6-db66-4a51-993d-83b91d04b6f3', 'c825fcb5-81cb-4a04-af42-f6e028c7c256', 'c25531ac-1338-4537-bac3-2cf75d5718fc', '981583de-a89e-4151-a22d-5cf3ac3a6fe7'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:54 devstack sudo[112066]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b" returned: 0 in 0.851s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:54 devstack sudo[112075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb Jun 25 18:24:54 devstack sudo[112075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:54 devstack sudo[112076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:54 devstack sudo[112076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:55 devstack sudo[112076]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.882s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:55 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:55 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Deleted volume successfully. Jun 25 18:24:55 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6fc6e1f1-4734-4c09-9eab-008d59021ced tempest-VolumesNegativeTest-871487508 None] Lock "cinder-0c670919-76e4-4d7f-b846-ae2aeb2edc0f-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:55 devstack sudo[112075]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb" returned: 0 in 1.018s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:55 devstack sudo[112084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb Jun 25 18:24:55 devstack sudo[112084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Flow 'volume_create_manager' (9b256b29-169b-4ec8-8616-1016645891ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135d9ff5-f762-4148-af60-5e77956f62a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135d9ff5-f762-4148-af60-5e77956f62a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1024009265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d48c46-017d-4f56-b1f1-56829cee5123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4ebf226bb04e6da7edb7772d85832a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:56Z,use_quota=True,user_id='a5c77e4e0bb7462a90eb1e081783bf29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa723b6e-b469-402f-94b8-84df2baa64f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa723b6e-b469-402f-94b8-84df2baa64f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854c1d1d-62bd-4b52-b93e-f05463d2c45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854c1d1d-62bd-4b52-b93e-f05463d2c45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72d48c46-017d-4f56-b1f1-56829cee5123', 'volume_name': 'volume-72d48c46-017d-4f56-b1f1-56829cee5123', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b39120-7427-433a-b857-a51ac05d061a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b39120-7427-433a-b857-a51ac05d061a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd9fff6-932d-41ca-966d-b15278e99273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:56 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Volume 72d48c46-017d-4f56-b1f1-56829cee5123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72d48c46-017d-4f56-b1f1-56829cee5123', 'volume_size': 1} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1024009265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d48c46-017d-4f56-b1f1-56829cee5123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4ebf226bb04e6da7edb7772d85832a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:56Z,use_quota=True,user_id='a5c77e4e0bb7462a90eb1e081783bf29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Creating volume 72d48c46-017d-4f56-b1f1-56829cee5123 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:56 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:56 devstack sudo[112087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 1073741824 Jun 25 18:24:56 devstack sudo[112087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:56 devstack sudo[112084]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b.db118237-cd66-404a-a73f-1b84ba7c73cb" returned: 0 in 0.904s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Lock "cinder-quobyte-db118237-cd66-404a-a73f-1b84ba7c73cb" released by "_delete_snapshot" :: held 3.857s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Lock "cinder-quobyte-9ce9524e-bc47-45fc-be59-d8ff9afb152b" released by "delete_snapshot" :: held 3.904s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Created reservations ['1e2070c7-6032-4e17-b502-9b724609c957', '5364e6de-9c20-471d-b06a-3b7007dcb05b', 'c8ab965b-6afa-4abb-b072-56d14526ea85', 'c1b7b19e-62ae-43a0-ae74-66ee91abfdea'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:56 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Delete snapshot completed successfully. Jun 25 18:24:56 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-921ae853-1264-4b59-9a3d-665ca76f99f7 tempest-CinderUnicodeTest-81121524 None] Lock "cinder-db118237-cd66-404a-a73f-1b84ba7c73cb-delete_snapshot" released by "delete_snapshot" :: held 4.151s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Acquiring lock "cinder-9ce9524e-bc47-45fc-be59-d8ff9afb152b-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Lock "cinder-9ce9524e-bc47-45fc-be59-d8ff9afb152b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Acquiring lock "cinder-quobyte-9ce9524e-bc47-45fc-be59-d8ff9afb152b" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:57 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Lock "cinder-quobyte-9ce9524e-bc47-45fc-be59-d8ff9afb152b" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:57 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[83122dd6-975a-4f09-94f4-769a32e1e41b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:57 devstack sudo[112089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b Jun 25 18:24:57 devstack sudo[112089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:57 devstack sudo[112087]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 1073741824" returned: 0 in 1.058s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:57 devstack sudo[112095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 Jun 25 18:24:57 devstack sudo[112095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:58 devstack sudo[112089]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b" returned: 0 in 0.908s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:58 devstack sudo[112101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b Jun 25 18:24:58 devstack sudo[112101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Flow 'volume_create_manager' (8db19a4a-0eb6-4a66-bf3a-a08b24d49b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29b1fd5-510d-49d3-aa6d-49bf1bffee34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29b1fd5-510d-49d3-aa6d-49bf1bffee34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-241333529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ce8987-fab1-4dca-b32d-41507f75ff8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2d887460524c8cad6150a01c8ce30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:58Z,use_quota=True,user_id='711a40020fe14eb3bf9b878c7d200543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f020e96-17ec-4c00-b524-edc385e27e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f020e96-17ec-4c00-b524-edc385e27e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3e333d-c5ed-4395-adcc-9992a44c1b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3e333d-c5ed-4395-adcc-9992a44c1b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ce8987-fab1-4dca-b32d-41507f75ff8a', 'volume_name': 'volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6259d22b-e3d2-4ac4-9372-a74f2da8c367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6259d22b-e3d2-4ac4-9372-a74f2da8c367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0434dd54-5811-4aea-9a0e-d97bce5e4118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:58 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Volume c4ce8987-fab1-4dca-b32d-41507f75ff8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a', 'volume_size': 1} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:58 devstack sudo[112095]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123" returned: 0 in 0.776s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.091s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-241333529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ce8987-fab1-4dca-b32d-41507f75ff8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2d887460524c8cad6150a01c8ce30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:24:58Z,use_quota=True,user_id='711a40020fe14eb3bf9b878c7d200543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Creating volume c4ce8987-fab1-4dca-b32d-41507f75ff8a {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:24:58 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd9fff6-932d-41ca-966d-b15278e99273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72d48c46-017d-4f56-b1f1-56829cee5123', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:58 devstack sudo[112105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a 1073741824 Jun 25 18:24:58 devstack sudo[112105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505967c5-1bad-4825-aca6-26371022be9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:24:58 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Volume volume-72d48c46-017d-4f56-b1f1-56829cee5123 (72d48c46-017d-4f56-b1f1-56829cee5123): created successfully Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505967c5-1bad-4825-aca6-26371022be9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Flow 'volume_create_manager' (9b256b29-169b-4ec8-8616-1016645891ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:24:58 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-14131b60-6649-4725-b4fb-d014e678dacb tempest-VolumeDependencyTests-614705277 None] Created volume successfully. Jun 25 18:24:58 devstack sudo[112101]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9ce9524e-bc47-45fc-be59-d8ff9afb152b" returned: 0 in 0.843s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:58 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Lock "cinder-quobyte-9ce9524e-bc47-45fc-be59-d8ff9afb152b" released by "delete_volume" :: held 1.836s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=126,cinder:INSERT=49,cinder:UPDATE=170,cinder:DELETE=13 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Created reservations ['b10d20d3-ba08-414f-87c1-9d9155d6eeea', 'e5c8dc3a-319b-4f07-8a3f-cb329e60a55f', '5e488470-d3b4-4b61-af76-26810827948a', '3330b4d8-fc7f-44d2-a611-92e8cef1eb1e'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:59 devstack sudo[112110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:24:59 devstack sudo[112110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Acquiring lock "cinder-73a43a62-ebc8-40ba-8452-c06b83be4df3-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Lock "cinder-73a43a62-ebc8-40ba-8452-c06b83be4df3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Acquiring lock "cinder-quobyte-73a43a62-ebc8-40ba-8452-c06b83be4df3" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Lock "cinder-quobyte-73a43a62-ebc8-40ba-8452-c06b83be4df3" acquired by "delete_volume" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d09a34a-1009-4115-8fef-2badea68561b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-73a43a62-ebc8-40ba-8452-c06b83be4df3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:59 devstack sudo[112114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-73a43a62-ebc8-40ba-8452-c06b83be4df3 Jun 25 18:24:59 devstack sudo[112114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:59 devstack sudo[112105]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a 1073741824" returned: 0 in 1.104s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:24:59 devstack sudo[112116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a Jun 25 18:24:59 devstack sudo[112116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:24:59 devstack sudo[112110]: pam_unix(sudo:session): session closed for user root Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.802s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:24:59 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Deleted volume successfully. Jun 25 18:24:59 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-8753f417-a790-4e0f-af21-5d0a9a738f43 tempest-CinderUnicodeTest-81121524 None] Lock "cinder-9ce9524e-bc47-45fc-be59-d8ff9afb152b-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:00 devstack sudo[112114]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-73a43a62-ebc8-40ba-8452-c06b83be4df3" returned: 0 in 0.902s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-73a43a62-ebc8-40ba-8452-c06b83be4df3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:00 devstack sudo[112123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-73a43a62-ebc8-40ba-8452-c06b83be4df3 Jun 25 18:25:00 devstack sudo[112123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:00 devstack sudo[112116]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a" returned: 0 in 0.832s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:25:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.552s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0434dd54-5811-4aea-9a0e-d97bce5e4118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88fa4f90-d9ea-428c-b20d-cffd66021217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] Creating offline snapshot 14e98981-0229-438b-aa49-234355d0e540 of volume 72d48c46-017d-4f56-b1f1-56829cee5123 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:25:00 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Volume volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a (c4ce8987-fab1-4dca-b32d-41507f75ff8a): created successfully Jun 25 18:25:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88fa4f90-d9ea-428c-b20d-cffd66021217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Flow 'volume_create_manager' (8db19a4a-0eb6-4a66-bf3a-a08b24d49b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:25:00 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cc5a63-d9b5-4d30-a251-7a6c7ceef27d]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:00 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-52fd5762-8ef4-4b80-a797-abe08b413e0a tempest-VolumesSnapshotListTestJSON-2089652428 None] Created volume successfully. Jun 25 18:25:00 devstack sudo[112125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 Jun 25 18:25:00 devstack sudo[112125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:01 devstack sudo[112123]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-73a43a62-ebc8-40ba-8452-c06b83be4df3" returned: 0 in 0.734s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:01 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Lock "cinder-quobyte-73a43a62-ebc8-40ba-8452-c06b83be4df3" released by "delete_volume" :: held 1.684s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:01 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Created reservations ['c9705c86-edcc-4c8e-adbc-8dcd2453f05f', 'e236ae05-d2f0-431d-858f-c709772597a9', 'f03862f7-d23f-4cd4-931b-1bfd0486b42a', '9705ce05-d24a-4630-92d2-46d8820c56c1'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:01 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:01 devstack sudo[112131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:25:01 devstack sudo[112131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:01 devstack sudo[112125]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123" returned: 0 in 0.840s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:01 devstack sudo[112136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 1G Jun 25 18:25:01 devstack sudo[112136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:02 devstack sudo[112131]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.870s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:02 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:25:02 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Deleted volume successfully. Jun 25 18:25:02 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2796c2c7-78c8-43d9-a044-48f0ca2da724 tempest-CinderUnicodeTest-81121524 None] Lock "cinder-73a43a62-ebc8-40ba-8452-c06b83be4df3-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:02 devstack sudo[112136]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 1G" returned: 0 in 0.917s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d48c46-017d-4f56-b1f1-56829cee5123 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:02 devstack sudo[112143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d48c46-017d-4f56-b1f1-56829cee5123 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 Jun 25 18:25:02 devstack sudo[112143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:03 devstack sudo[112143]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d48c46-017d-4f56-b1f1-56829cee5123 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540" returned: 0 in 0.757s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:03 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 is being set with open permissions: ugo+rw Jun 25 18:25:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:03 devstack sudo[112148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 Jun 25 18:25:03 devstack sudo[112148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:03 devstack sudo[112148]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540" returned: 0 in 0.759s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:03 devstack sudo[112154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.info Jun 25 18:25:03 devstack sudo[112154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:04 devstack sudo[112154]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.info" returned: 0 in 0.836s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:04 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.info is being set with open permissions: ugo+rw Jun 25 18:25:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:04 devstack sudo[112157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.info Jun 25 18:25:04 devstack sudo[112157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:05 devstack sudo[112157]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.info" returned: 0 in 0.763s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.004s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.741s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] Creating offline snapshot 7ae75a3b-cbf9-449f-bc39-507ddbc17754 of volume c4ce8987-fab1-4dca-b32d-41507f75ff8a {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:25:05 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-efebf2d5-1fd6-440b-b143-30cd7832130c tempest-VolumeDependencyTests-614705277 None] Create snapshot completed successfully Jun 25 18:25:05 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bbb832-a812-494a-b3e7-dd1074c54fbd]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:05 devstack sudo[112160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a Jun 25 18:25:05 devstack sudo[112160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:06 devstack sudo[112160]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a" returned: 0 in 0.924s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:06 devstack sudo[112165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 1G Jun 25 18:25:06 devstack sudo[112165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:06 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:25:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Flow 'volume_create_manager' (9fbf6d28-d907-4615-b96e-6342818a5135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:25:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27a5c64-9945-4480-ac50-18f67e0009ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27a5c64-9945-4480-ac50-18f67e0009ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1780189841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df388d3-dd4a-4f2b-94cc-f46f58e9dafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4ebf226bb04e6da7edb7772d85832a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=14e98981-0229-438b-aa49-234355d0e540,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:25:07Z,use_quota=True,user_id='a5c77e4e0bb7462a90eb1e081783bf29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272d06ef-591a-4363-9f77-5aa1d1f02421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272d06ef-591a-4363-9f77-5aa1d1f02421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea672b7-e725-4b86-9d08-d70098bb3c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea672b7-e725-4b86-9d08-d70098bb3c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4df388d3-dd4a-4f2b-94cc-f46f58e9dafe', 'volume_name': 'volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe', 'volume_size': 1, 'snapshot_id': '14e98981-0229-438b-aa49-234355d0e540'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfceca70-a5f0-4bb3-918c-ca67e1877aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfceca70-a5f0-4bb3-918c-ca67e1877aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af28f9b6-7ac1-4a96-a36b-c14f1a532030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:06 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Volume 4df388d3-dd4a-4f2b-94cc-f46f58e9dafe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe', 'volume_size': 1, 'snapshot_id': '14e98981-0229-438b-aa49-234355d0e540'} Jun 25 18:25:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:07 devstack sudo[112165]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 1G" returned: 0 in 0.976s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:07 devstack sudo[112170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 Jun 25 18:25:07 devstack sudo[112170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:08 devstack sudo[112170]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754" returned: 0 in 0.744s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:08 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 is being set with open permissions: ugo+rw Jun 25 18:25:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:08 devstack sudo[112175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 Jun 25 18:25:08 devstack sudo[112175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:08 devstack sudo[112175]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754" returned: 0 in 0.749s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:09 devstack sudo[112179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.info Jun 25 18:25:09 devstack sudo[112179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:09 devstack sudo[112179]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.info" returned: 0 in 0.738s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:09 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.info is being set with open permissions: ugo+rw Jun 25 18:25:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:09 devstack sudo[112182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.info Jun 25 18:25:09 devstack sudo[112182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:10 devstack sudo[112182]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.info" returned: 0 in 0.703s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.952s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.547s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Acquiring lock "cinder-quobyte-14e98981-0229-438b-aa49-234355d0e540-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe" by "_create_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Lock "cinder-quobyte-14e98981-0229-438b-aa49-234355d0e540-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Creating volume 4df388d3-dd4a-4f2b-94cc-f46f58e9dafe from snapshot 14e98981-0229-438b-aa49-234355d0e540 {{(pid=93651) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Acquiring lock "cinder-quobyte-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe" by "_copy_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-8f00fce6-42ac-4c28-abc1-39c06c23ee87 tempest-VolumesSnapshotListTestJSON-2089652428 None] Create snapshot completed successfully Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Lock "cinder-quobyte-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] snapshot: 14e98981-0229-438b-aa49-234355d0e540, volume: 4df388d3-dd4a-4f2b-94cc-f46f58e9dafe, {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[025a75ac-ba41-4ed8-b719-f95be72f9ced]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:10 devstack sudo[112185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 Jun 25 18:25:10 devstack sudo[112185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:11 devstack sudo[112185]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540" returned: 0 in 0.877s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72d48c46-017d-4f56-b1f1-56829cee5123(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:25:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] will copy from snapshot at /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:25:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Creating direct copy from snapshot {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:25:11 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[765de28b-9c15-40e3-8f94-765ab0669b29]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:11 devstack sudo[112190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 Jun 25 18:25:11 devstack sudo[112190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:12 devstack sudo[112190]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123" returned: 0 in 0.854s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:12 devstack cinder-volume[93651]: DEBUG cinder.utils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Path /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe not found in is_blk_device check {{(pid=93651) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:25:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:12 devstack sudo[112195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe Jun 25 18:25:12 devstack sudo[112195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:17 devstack sudo[112195]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe" returned: 0 in 4.724s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:17 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a535b9-ccff-42e9-b302-090a09178807]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:17 devstack sudo[112208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 Jun 25 18:25:17 devstack sudo[112208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:18 devstack sudo[112208]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123" returned: 0 in 0.983s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Image conversion details: src /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123, size 1024.00 MB, duration 4.73 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:25:18 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Converted 1024.00 MB image at 216.70 MB/s Jun 25 18:25:18 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe is being set with open permissions: ugo+rw Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:18 devstack sudo[112213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe Jun 25 18:25:18 devstack sudo[112213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:18 devstack sudo[112213]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe" returned: 0 in 0.734s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Lock "cinder-quobyte-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe" released by "_copy_volume_from_snapshot" :: held 8.269s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Lock "cinder-quobyte-14e98981-0229-438b-aa49-234355d0e540-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe" released by "_create_volume_from_snapshot" :: held 8.315s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.337s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.399s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] Creating offline snapshot a77ff975-00c1-492c-b7e6-416f940549b6 of volume c4ce8987-fab1-4dca-b32d-41507f75ff8a {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af28f9b6-7ac1-4a96-a36b-c14f1a532030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe', 'volume_size': 1, 'snapshot_id': '14e98981-0229-438b-aa49-234355d0e540'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0460ed-3399-40ae-8a65-b8bc98aa8458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[40db93ca-bbfc-4889-ad0a-16197da2d579]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:18 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Volume volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe (4df388d3-dd4a-4f2b-94cc-f46f58e9dafe): created successfully Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0460ed-3399-40ae-8a65-b8bc98aa8458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:18 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Flow 'volume_create_manager' (9fbf6d28-d907-4615-b96e-6342818a5135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:25:18 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-45501138-4a96-4024-a13b-2ccaabe9ceec tempest-VolumeDependencyTests-614705277 None] Created volume successfully. Jun 25 18:25:19 devstack sudo[112217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 Jun 25 18:25:19 devstack sudo[112217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:19 devstack sudo[112217]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754" returned: 0 in 0.773s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:25:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:19 devstack sudo[112223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 1G Jun 25 18:25:19 devstack sudo[112223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Acquiring lock "cinder-14e98981-0229-438b-aa49-234355d0e540-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Lock "cinder-14e98981-0229-438b-aa49-234355d0e540-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Acquiring lock "cinder-quobyte-72d48c46-017d-4f56-b1f1-56829cee5123" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Lock "cinder-quobyte-72d48c46-017d-4f56-b1f1-56829cee5123" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Acquiring lock "cinder-quobyte-14e98981-0229-438b-aa49-234355d0e540" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Lock "cinder-quobyte-14e98981-0229-438b-aa49-234355d0e540" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Deleting offline snapshot 14e98981-0229-438b-aa49-234355d0e540 of volume 72d48c46-017d-4f56-b1f1-56829cee5123 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:25:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] snapshot_file for this snap is: volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:25:19 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19f9080-3244-413e-801e-6e81be70a5dc]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:19 devstack sudo[112225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 Jun 25 18:25:20 devstack sudo[112225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:20 devstack sudo[112223]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 1G" returned: 0 in 0.945s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:20 devstack sudo[112232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 Jun 25 18:25:20 devstack sudo[112232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:20 devstack sudo[112225]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540" returned: 0 in 0.846s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72d48c46-017d-4f56-b1f1-56829cee5123(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:25:20 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb71a1f9-66b0-49cf-a15a-456d2ce1ad24]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:20 devstack sudo[112235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 Jun 25 18:25:20 devstack sudo[112235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:21 devstack sudo[112232]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6" returned: 0 in 0.754s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:21 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 is being set with open permissions: ugo+rw Jun 25 18:25:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:21 devstack sudo[112240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 Jun 25 18:25:21 devstack sudo[112240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:21 devstack sudo[112235]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123" returned: 0 in 0.781s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:21 devstack sudo[112245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 Jun 25 18:25:21 devstack sudo[112245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:22 devstack sudo[112240]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6" returned: 0 in 0.691s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.298s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:22 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-a7a0e86a-066c-4a5e-a163-df46638afe50 tempest-VolumesSnapshotListTestJSON-2089652428 None] Create snapshot completed successfully Jun 25 18:25:22 devstack sudo[112245]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540" returned: 0 in 0.753s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:22 devstack sudo[112251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540 Jun 25 18:25:22 devstack sudo[112251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:22 devstack sudo[112251]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123.14e98981-0229-438b-aa49-234355d0e540" returned: 0 in 0.685s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:23 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Lock "cinder-quobyte-14e98981-0229-438b-aa49-234355d0e540" released by "_delete_snapshot" :: held 3.170s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:23 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Lock "cinder-quobyte-72d48c46-017d-4f56-b1f1-56829cee5123" released by "delete_snapshot" :: held 3.200s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:23 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Created reservations ['ffabbce7-3571-4f84-85a7-6d667acd3b9e', '31683291-f6f0-4c1b-b53d-2a3d9c854a66', 'ce2dfdcc-7a1b-4db4-a8b3-02ebfc2d5511', '884387be-2e5e-4499-90e1-cc6d31605a97'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:23 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Delete snapshot completed successfully. Jun 25 18:25:23 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-a08296a0-30b2-4432-9d09-f91cd0450715 tempest-VolumeDependencyTests-614705277 None] Lock "cinder-14e98981-0229-438b-aa49-234355d0e540-delete_snapshot" released by "delete_snapshot" :: held 3.394s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] Creating offline snapshot f93d8500-9f89-49f2-98e9-b7b36c35f545 of volume c4ce8987-fab1-4dca-b32d-41507f75ff8a {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:25:23 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[06358f2c-c1bb-48db-91e3-146a889092b7]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:23 devstack sudo[112254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 Jun 25 18:25:23 devstack sudo[112254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:24 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Acquiring lock "cinder-72d48c46-017d-4f56-b1f1-56829cee5123-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:24 devstack sudo[112254]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6" returned: 0 in 0.781s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:25:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:24 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Lock "cinder-72d48c46-017d-4f56-b1f1-56829cee5123-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:24 devstack sudo[112259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 1G Jun 25 18:25:24 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=92,cinder:INSERT=38,cinder:UPDATE=123,cinder:DELETE=14 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:25:24 devstack sudo[112259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:24 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Acquiring lock "cinder-quobyte-72d48c46-017d-4f56-b1f1-56829cee5123" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:24 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Lock "cinder-quobyte-72d48c46-017d-4f56-b1f1-56829cee5123" acquired by "delete_volume" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:24 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[2534f73b-add0-42f3-a30e-33d8998d77b5]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:24 devstack sudo[112261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 Jun 25 18:25:24 devstack sudo[112261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:25 devstack sudo[112261]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123" returned: 0 in 0.956s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:25 devstack sudo[112259]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 1G" returned: 0 in 1.150s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:25 devstack sudo[112685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123 Jun 25 18:25:25 devstack sudo[112685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:25 devstack sudo[112686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 Jun 25 18:25:25 devstack sudo[112686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:25 devstack sudo[112685]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-72d48c46-017d-4f56-b1f1-56829cee5123" returned: 0 in 0.679s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Lock "cinder-quobyte-72d48c46-017d-4f56-b1f1-56829cee5123" released by "delete_volume" :: held 1.717s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:25 devstack sudo[112686]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545" returned: 0 in 0.749s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:25 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 is being set with open permissions: ugo+rw Jun 25 18:25:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:26 devstack sudo[112693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 Jun 25 18:25:26 devstack sudo[112693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Created reservations ['8de6c311-a5fb-4eed-8b97-aff91d9c4fa3', '1fd96867-810c-492a-a4c9-f973ffd46146', 'c2aeeacb-f24a-4b3d-81d4-296d9b2246fe', '0e8bf237-0445-483b-a7c0-a1ae5249a133'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:26 devstack sudo[112695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:25:26 devstack sudo[112695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Acquiring lock "cinder-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Lock "cinder-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Acquiring lock "cinder-quobyte-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Lock "cinder-quobyte-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe" acquired by "delete_volume" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[39690fc8-b989-4857-9ddb-925d2cc51349]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:26 devstack sudo[112697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe Jun 25 18:25:26 devstack sudo[112697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:26 devstack sudo[112693]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545" returned: 0 in 0.759s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.551s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:26 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-dca09ba5-29bf-4308-907b-706bc6a8d3b7 tempest-VolumesSnapshotListTestJSON-2089652428 None] Create snapshot completed successfully Jun 25 18:25:27 devstack sudo[112695]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.784s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:27 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:25:27 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Deleted volume successfully. Jun 25 18:25:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-2f095c09-4c48-4fc6-a5be-f749bce7b59f tempest-VolumeDependencyTests-614705277 None] Lock "cinder-72d48c46-017d-4f56-b1f1-56829cee5123-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:27 devstack sudo[112697]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe" returned: 0 in 0.846s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:27 devstack sudo[112704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe Jun 25 18:25:27 devstack sudo[112704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:28 devstack sudo[112704]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe" returned: 0 in 0.733s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Lock "cinder-quobyte-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe" released by "delete_volume" :: held 1.627s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Created reservations ['d1485a36-d1c5-41f8-aa3f-5c189276ba37', '903f5362-1c1b-4a83-8ae0-c7c6c9c13f01', '2359ccbe-8cda-448c-899c-ea66068aa83d', 'b246eac8-55de-4df4-a273-e6772f612df6'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "cinder-f93d8500-9f89-49f2-98e9-b7b36c35f545-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:28 devstack sudo[112707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:25:28 devstack sudo[112707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-f93d8500-9f89-49f2-98e9-b7b36c35f545-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "cinder-quobyte-c4ce8987-fab1-4dca-b32d-41507f75ff8a" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-quobyte-c4ce8987-fab1-4dca-b32d-41507f75ff8a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "cinder-quobyte-f93d8500-9f89-49f2-98e9-b7b36c35f545" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-quobyte-f93d8500-9f89-49f2-98e9-b7b36c35f545" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Deleting offline snapshot f93d8500-9f89-49f2-98e9-b7b36c35f545 of volume c4ce8987-fab1-4dca-b32d-41507f75ff8a {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] snapshot_file for this snap is: volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c4dd3c-ad4a-496b-952b-6c0194faeec4]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:28 devstack sudo[112710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 Jun 25 18:25:28 devstack sudo[112710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:28 devstack sudo[112707]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.770s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:28 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:25:28 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Deleted volume successfully. Jun 25 18:25:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e1ffcc2f-db12-4aa7-9496-28497855feea tempest-VolumeDependencyTests-614705277 None] Lock "cinder-4df388d3-dd4a-4f2b-94cc-f46f58e9dafe-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:29 devstack sudo[112710]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545" returned: 0 in 0.872s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:25:29 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efc1d5b-c08a-46f8-97fd-e3b82efe0313]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:29 devstack sudo[112716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 Jun 25 18:25:29 devstack sudo[112716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:30 devstack sudo[112716]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6" returned: 0 in 0.889s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:25:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:30 devstack sudo[112722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 Jun 25 18:25:30 devstack sudo[112722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:31 devstack sudo[112722]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545" returned: 0 in 0.887s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:31 devstack sudo[112765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545 Jun 25 18:25:31 devstack sudo[112765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:31 devstack sudo[112765]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.f93d8500-9f89-49f2-98e9-b7b36c35f545" returned: 0 in 0.795s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-quobyte-f93d8500-9f89-49f2-98e9-b7b36c35f545" released by "_delete_snapshot" :: held 3.560s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-quobyte-c4ce8987-fab1-4dca-b32d-41507f75ff8a" released by "delete_snapshot" :: held 3.589s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:31 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Created reservations ['06635b45-41e2-424c-a675-127b3ec4c8c6', '77fc898e-914c-48fa-969b-04312652a471', 'fabf7f05-9cf8-4cce-b4ce-971812a6cbd4', 'fcb9dae5-a31c-4626-9b1e-0df2b7a5d92a'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:31 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Delete snapshot completed successfully. Jun 25 18:25:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-dc615f92-3da8-4324-8e5e-a17da21af12b tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-f93d8500-9f89-49f2-98e9-b7b36c35f545-delete_snapshot" released by "delete_snapshot" :: held 3.735s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "cinder-a77ff975-00c1-492c-b7e6-416f940549b6-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-a77ff975-00c1-492c-b7e6-416f940549b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "cinder-quobyte-c4ce8987-fab1-4dca-b32d-41507f75ff8a" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-quobyte-c4ce8987-fab1-4dca-b32d-41507f75ff8a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "cinder-quobyte-a77ff975-00c1-492c-b7e6-416f940549b6" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-quobyte-a77ff975-00c1-492c-b7e6-416f940549b6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Deleting offline snapshot a77ff975-00c1-492c-b7e6-416f940549b6 of volume c4ce8987-fab1-4dca-b32d-41507f75ff8a {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:25:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] snapshot_file for this snap is: volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:25:32 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aff1565-160f-4685-bef2-2177c870c42e]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:32 devstack sudo[112769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 Jun 25 18:25:32 devstack sudo[112769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:33 devstack sudo[112769]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6" returned: 0 in 1.119s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:33 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:25:33 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e36685-fad7-497b-b85b-e3d2992d2783]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:33 devstack sudo[112774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 Jun 25 18:25:33 devstack sudo[112774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:34 devstack sudo[112774]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754" returned: 0 in 0.868s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:25:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:34 devstack sudo[112779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 Jun 25 18:25:34 devstack sudo[112779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:35 devstack sudo[112779]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6" returned: 0 in 0.944s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:35 devstack sudo[112785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6 Jun 25 18:25:35 devstack sudo[112785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:36 devstack sudo[112785]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.a77ff975-00c1-492c-b7e6-416f940549b6" returned: 0 in 0.715s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-quobyte-a77ff975-00c1-492c-b7e6-416f940549b6" released by "_delete_snapshot" :: held 3.801s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-quobyte-c4ce8987-fab1-4dca-b32d-41507f75ff8a" released by "delete_snapshot" :: held 3.829s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Created reservations ['4e6237c9-bb33-4a58-a5ac-3d17b35ea0a4', 'ba1f249f-917a-4e74-b205-6a4f71788eee', '54c4f80b-068a-4f3b-9173-7140fe7208c1', 'd8086c79-8257-4540-bcba-002720b360df'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:36 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Delete snapshot completed successfully. Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cf15696c-a3e8-4536-ab1f-624c0889e4e6 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-a77ff975-00c1-492c-b7e6-416f940549b6-delete_snapshot" released by "delete_snapshot" :: held 4.070s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "cinder-7ae75a3b-cbf9-449f-bc39-507ddbc17754-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-7ae75a3b-cbf9-449f-bc39-507ddbc17754-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "cinder-quobyte-c4ce8987-fab1-4dca-b32d-41507f75ff8a" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-quobyte-c4ce8987-fab1-4dca-b32d-41507f75ff8a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "cinder-quobyte-7ae75a3b-cbf9-449f-bc39-507ddbc17754" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-quobyte-7ae75a3b-cbf9-449f-bc39-507ddbc17754" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Deleting offline snapshot 7ae75a3b-cbf9-449f-bc39-507ddbc17754 of volume c4ce8987-fab1-4dca-b32d-41507f75ff8a {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] snapshot_file for this snap is: volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec91a424-b247-4b2a-9caa-f3f344b7d0df]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:37 devstack sudo[112788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 Jun 25 18:25:37 devstack sudo[112788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:37 devstack sudo[112788]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754" returned: 0 in 0.909s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:37 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:25:37 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[170ae099-fd88-4761-9aba-62bc4c73c6d9]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:37 devstack sudo[112793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a Jun 25 18:25:37 devstack sudo[112793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:38 devstack sudo[112793]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a" returned: 0 in 0.941s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:38 devstack sudo[112799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 Jun 25 18:25:38 devstack sudo[112799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:25:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:39 devstack sudo[112801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:25:39 devstack sudo[112801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:39 devstack sudo[112799]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754" returned: 0 in 0.997s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:39 devstack sudo[112806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754 Jun 25 18:25:39 devstack sudo[112806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:40 devstack sudo[112801]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.850s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:25:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:25:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 28 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:25:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:25:40 devstack sudo[112806]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a.7ae75a3b-cbf9-449f-bc39-507ddbc17754" returned: 0 in 0.840s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:40 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-quobyte-7ae75a3b-cbf9-449f-bc39-507ddbc17754" released by "_delete_snapshot" :: held 3.830s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:40 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-quobyte-c4ce8987-fab1-4dca-b32d-41507f75ff8a" released by "delete_snapshot" :: held 3.858s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:40 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Created reservations ['fa223b79-a73c-4f42-8c4f-b7179f041b27', 'd6e01c4b-f212-4968-b2a7-029e80019e86', 'a6dd1213-f4ae-4548-9be1-6cc2d95e30be', '80ec5f63-e9da-4c87-9ae4-709daaa50dab'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:40 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Delete snapshot completed successfully. Jun 25 18:25:40 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-b34ac01a-8c93-4926-9f46-f5017b3ecc5e tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-7ae75a3b-cbf9-449f-bc39-507ddbc17754-delete_snapshot" released by "delete_snapshot" :: held 4.050s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "cinder-c4ce8987-fab1-4dca-b32d-41507f75ff8a-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-c4ce8987-fab1-4dca-b32d-41507f75ff8a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "cinder-quobyte-c4ce8987-fab1-4dca-b32d-41507f75ff8a" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:25:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-quobyte-c4ce8987-fab1-4dca-b32d-41507f75ff8a" acquired by "delete_volume" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:25:41 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccb45ba-3881-484d-bbde-02fef14281fa]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:41 devstack sudo[112810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a Jun 25 18:25:41 devstack sudo[112810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:42 devstack sudo[112810]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a" returned: 0 in 0.849s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:42 devstack sudo[112815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a Jun 25 18:25:42 devstack sudo[112815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:42 devstack sudo[112815]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c4ce8987-fab1-4dca-b32d-41507f75ff8a" returned: 0 in 0.869s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-quobyte-c4ce8987-fab1-4dca-b32d-41507f75ff8a" released by "delete_volume" :: held 1.799s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:43 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Created reservations ['600b37ad-4548-47d5-982b-e9b6edd8e573', '93e3c8ca-bda1-45d7-8b07-887d013b120d', 'cee41900-a83d-4efa-b1af-a086bf4de431', 'd4fd457f-8b00-4277-a495-5d055244f653'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:25:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:43 devstack sudo[112818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:25:43 devstack sudo[112818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:43 devstack sudo[112818]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.775s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:43 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:25:43 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Deleted volume successfully. Jun 25 18:25:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-37139d84-68fa-4645-bb41-32a97f83d3a1 tempest-VolumesSnapshotListTestJSON-2089652428 None] Lock "cinder-c4ce8987-fab1-4dca-b32d-41507f75ff8a-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:25:53 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=28,cinder:INSERT=8,cinder:UPDATE=46,cinder:DELETE=2 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:25:54 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=67,cinder:SELECT=60,cinder:DELETE=5,cinder:INSERT=19 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Flow 'volume_create_manager' (b164723b-ce55-4805-9227-e07c1e9b47e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20b0087-d0fd-4239-9c9b-7bde07db74a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20b0087-d0fd-4239-9c9b-7bde07db74a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-169732541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c4b7d2-65f3-4e54-a370-6dbb4140866d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67033cbf962e4e0d8947abbc3d63be60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:25:55Z,use_quota=True,user_id='9fbe45a90d3f4b999eab053d7887a173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39cca33-3d23-401a-bed4-e2041922d893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39cca33-3d23-401a-bed4-e2041922d893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d82f5f-e37d-4600-98a3-a8ce1208367f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d82f5f-e37d-4600-98a3-a8ce1208367f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83c4b7d2-65f3-4e54-a370-6dbb4140866d', 'volume_name': 'volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68151d60-73a1-4246-bc56-5ba2720d87c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68151d60-73a1-4246-bc56-5ba2720d87c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31d7a8e-5659-416d-9fa2-eda92b674bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:55 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Volume 83c4b7d2-65f3-4e54-a370-6dbb4140866d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d', 'volume_size': 1} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-169732541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c4b7d2-65f3-4e54-a370-6dbb4140866d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67033cbf962e4e0d8947abbc3d63be60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:25:55Z,use_quota=True,user_id='9fbe45a90d3f4b999eab053d7887a173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Creating volume 83c4b7d2-65f3-4e54-a370-6dbb4140866d {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:25:55 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:25:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:55 devstack sudo[112833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d 1073741824 Jun 25 18:25:55 devstack sudo[112833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:56 devstack sudo[112833]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d 1073741824" returned: 0 in 0.980s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:56 devstack sudo[112838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d Jun 25 18:25:56 devstack sudo[112838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:57 devstack sudo[112838]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d" returned: 0 in 0.713s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:25:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:25:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31d7a8e-5659-416d-9fa2-eda92b674bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f1663e-a2d6-409e-848e-b6d2139b08f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:25:57 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Volume volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d (83c4b7d2-65f3-4e54-a370-6dbb4140866d): created successfully Jun 25 18:25:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f1663e-a2d6-409e-848e-b6d2139b08f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:25:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Flow 'volume_create_manager' (b164723b-ce55-4805-9227-e07c1e9b47e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:25:57 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-086641c9-f1e0-4317-9bf4-8942143f7942 tempest-SnapshotDependencyTests-818739072 None] Created volume successfully. Jun 25 18:25:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:25:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:25:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] Creating offline snapshot 532ed268-8023-4ae2-9339-81d0cc847739 of volume 83c4b7d2-65f3-4e54-a370-6dbb4140866d {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:25:57 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa0eba7-a873-424c-ad32-b48918b45557]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:25:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:57 devstack sudo[112841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d Jun 25 18:25:57 devstack sudo[112841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:58 devstack sudo[112841]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d" returned: 0 in 0.959s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:58 devstack sudo[112847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 1G Jun 25 18:25:58 devstack sudo[112847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:25:59 devstack sudo[112847]: pam_unix(sudo:session): session closed for user root Jun 25 18:25:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 1G" returned: 0 in 0.929s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:25:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:25:59 devstack sudo[112853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 Jun 25 18:25:59 devstack sudo[112853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:00 devstack sudo[112853]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739" returned: 0 in 0.859s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:00 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 is being set with open permissions: ugo+rw Jun 25 18:26:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:00 devstack sudo[112859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 Jun 25 18:26:00 devstack sudo[112859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:01 devstack sudo[112859]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739" returned: 0 in 0.743s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:01 devstack sudo[112862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.info Jun 25 18:26:01 devstack sudo[112862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:02 devstack sudo[112862]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.info" returned: 0 in 0.745s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:02 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.info is being set with open permissions: ugo+rw Jun 25 18:26:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:02 devstack sudo[112865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.info Jun 25 18:26:02 devstack sudo[112865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:02 devstack sudo[112865]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.info" returned: 0 in 0.662s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:02 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-dc6facd9-75e7-41ca-84eb-081fa3baf5f1 tempest-SnapshotDependencyTests-818739072 None] Create snapshot completed successfully Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Flow 'volume_create_manager' (5d0f025e-c21b-4acc-a7cc-85217ebea5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4964762-4490-4b47-917e-0b69243188d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4964762-4490-4b47-917e-0b69243188d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e88cb12-a428-4c3f-86c9-b07816f91a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67033cbf962e4e0d8947abbc3d63be60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=532ed268-8023-4ae2-9339-81d0cc847739,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:26:04Z,use_quota=True,user_id='9fbe45a90d3f4b999eab053d7887a173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13dc8ecc-981c-4d47-86ed-d64095da90b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13dc8ecc-981c-4d47-86ed-d64095da90b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0716e39-514f-42d9-bf1b-2f8c4228c93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0716e39-514f-42d9-bf1b-2f8c4228c93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2e88cb12-a428-4c3f-86c9-b07816f91a72', 'volume_name': 'volume-2e88cb12-a428-4c3f-86c9-b07816f91a72', 'volume_size': 1, 'snapshot_id': '532ed268-8023-4ae2-9339-81d0cc847739'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc247f5-3530-4267-a7ef-8886412f032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc247f5-3530-4267-a7ef-8886412f032f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801bc397-3d4b-4448-b416-25a4a73a1daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:03 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Volume 2e88cb12-a428-4c3f-86c9-b07816f91a72: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2e88cb12-a428-4c3f-86c9-b07816f91a72', 'volume_size': 1, 'snapshot_id': '532ed268-8023-4ae2-9339-81d0cc847739'} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "cinder-quobyte-532ed268-8023-4ae2-9339-81d0cc847739-2e88cb12-a428-4c3f-86c9-b07816f91a72" by "_create_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-quobyte-532ed268-8023-4ae2-9339-81d0cc847739-2e88cb12-a428-4c3f-86c9-b07816f91a72" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Creating volume 2e88cb12-a428-4c3f-86c9-b07816f91a72 from snapshot 532ed268-8023-4ae2-9339-81d0cc847739 {{(pid=93651) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "cinder-quobyte-2e88cb12-a428-4c3f-86c9-b07816f91a72" by "_copy_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-quobyte-2e88cb12-a428-4c3f-86c9-b07816f91a72" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] snapshot: 532ed268-8023-4ae2-9339-81d0cc847739, volume: 2e88cb12-a428-4c3f-86c9-b07816f91a72, {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e836e599-e333-444c-a7ff-be49de3fa834]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:03 devstack sudo[112868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 Jun 25 18:26:03 devstack sudo[112868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:04 devstack sudo[112868]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739" returned: 0 in 0.929s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:26:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] will copy from snapshot at /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:26:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Creating direct copy from snapshot {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:26:04 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[51af96aa-dc02-4e61-9c6e-a3493974b60b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:04 devstack sudo[112873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d Jun 25 18:26:04 devstack sudo[112873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:05 devstack sudo[112873]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d" returned: 0 in 0.938s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:05 devstack cinder-volume[93651]: DEBUG cinder.utils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Path /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72 not found in is_blk_device check {{(pid=93651) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:26:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:05 devstack sudo[112879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72 Jun 25 18:26:05 devstack sudo[112879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:11 devstack sudo[112879]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72" returned: 0 in 5.478s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:11 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b09aea-a4cb-4d90-9276-8d9cc2d18929]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:11 devstack sudo[112893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d Jun 25 18:26:11 devstack sudo[112893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:12 devstack sudo[112893]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d" returned: 0 in 0.991s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:12 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Image conversion details: src /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:26:12 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Converted 1024.00 MB image at 186.90 MB/s Jun 25 18:26:12 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72 is being set with open permissions: ugo+rw Jun 25 18:26:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:12 devstack sudo[112898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72 Jun 25 18:26:12 devstack sudo[112898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:13 devstack sudo[112898]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72" returned: 0 in 0.826s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-quobyte-2e88cb12-a428-4c3f-86c9-b07816f91a72" released by "_copy_volume_from_snapshot" :: held 9.282s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-quobyte-532ed268-8023-4ae2-9339-81d0cc847739-2e88cb12-a428-4c3f-86c9-b07816f91a72" released by "_create_volume_from_snapshot" :: held 9.314s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.331s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801bc397-3d4b-4448-b416-25a4a73a1daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e88cb12-a428-4c3f-86c9-b07816f91a72', 'volume_size': 1, 'snapshot_id': '532ed268-8023-4ae2-9339-81d0cc847739'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f7e5ef-971c-4e77-aab1-c5bbb039de58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:13 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Volume volume-2e88cb12-a428-4c3f-86c9-b07816f91a72 (2e88cb12-a428-4c3f-86c9-b07816f91a72): created successfully Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f7e5ef-971c-4e77-aab1-c5bbb039de58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Flow 'volume_create_manager' (5d0f025e-c21b-4acc-a7cc-85217ebea5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:26:13 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7983d7b9-9123-49eb-94c1-0762706aa6bd tempest-SnapshotDependencyTests-818739072 None] Created volume successfully. Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "cinder-532ed268-8023-4ae2-9339-81d0cc847739-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-532ed268-8023-4ae2-9339-81d0cc847739-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "cinder-quobyte-83c4b7d2-65f3-4e54-a370-6dbb4140866d" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-quobyte-83c4b7d2-65f3-4e54-a370-6dbb4140866d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "cinder-quobyte-532ed268-8023-4ae2-9339-81d0cc847739" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-quobyte-532ed268-8023-4ae2-9339-81d0cc847739" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Deleting offline snapshot 532ed268-8023-4ae2-9339-81d0cc847739 of volume 83c4b7d2-65f3-4e54-a370-6dbb4140866d {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] snapshot_file for this snap is: volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a2d60c-dee2-4d2d-8879-c7790529eb60]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:13 devstack sudo[112902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 Jun 25 18:26:13 devstack sudo[112902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:14 devstack sudo[112902]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739" returned: 0 in 0.834s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:26:14 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc592557-47a2-480e-ba1f-f4e12842b004]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:14 devstack sudo[112907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d Jun 25 18:26:14 devstack sudo[112907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:15 devstack sudo[112907]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d" returned: 0 in 0.789s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:15 devstack sudo[112913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 Jun 25 18:26:15 devstack sudo[112913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:16 devstack sudo[112913]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739" returned: 0 in 0.790s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:16 devstack sudo[112918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739 Jun 25 18:26:16 devstack sudo[112918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:16 devstack sudo[112918]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d.532ed268-8023-4ae2-9339-81d0cc847739" returned: 0 in 0.733s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-quobyte-532ed268-8023-4ae2-9339-81d0cc847739" released by "_delete_snapshot" :: held 3.287s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-quobyte-83c4b7d2-65f3-4e54-a370-6dbb4140866d" released by "delete_snapshot" :: held 3.313s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:17 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Created reservations ['29d90486-361d-4b50-a637-82b56e491061', 'fed3e562-1512-44e1-a135-6ff8fa83a02b', '82acee3d-74c9-4e4b-8883-8818c09759af', '015c9195-e761-4b9f-8c7f-a10503b97b77'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:26:17 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Delete snapshot completed successfully. Jun 25 18:26:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1f83a3da-ec8b-46b1-9910-b5d3307530f3 tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-532ed268-8023-4ae2-9339-81d0cc847739-delete_snapshot" released by "delete_snapshot" :: held 3.478s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "cinder-83c4b7d2-65f3-4e54-a370-6dbb4140866d-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-83c4b7d2-65f3-4e54-a370-6dbb4140866d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "cinder-quobyte-83c4b7d2-65f3-4e54-a370-6dbb4140866d" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-quobyte-83c4b7d2-65f3-4e54-a370-6dbb4140866d" acquired by "delete_volume" :: waited 0.014s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:18 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0407df-a0b5-4b2e-b377-1ee6e80ca9cc]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:18 devstack sudo[112924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d Jun 25 18:26:18 devstack sudo[112924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:18 devstack sudo[112924]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d" returned: 0 in 0.770s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:18 devstack sudo[112930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d Jun 25 18:26:18 devstack sudo[112930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:19 devstack sudo[112930]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-83c4b7d2-65f3-4e54-a370-6dbb4140866d" returned: 0 in 0.717s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-quobyte-83c4b7d2-65f3-4e54-a370-6dbb4140866d" released by "delete_volume" :: held 1.555s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:19 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Created reservations ['f6789e75-bd57-45d6-8d15-ab028e806e0a', '1461dca5-aa47-4e57-b8c0-3df5b893e94e', 'cbc9d27d-f914-4d5b-95cd-5b029d2348b5', '86c18b31-f500-4786-881f-af40db12a503'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:26:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:19 devstack sudo[112933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:26:19 devstack sudo[112933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "cinder-2e88cb12-a428-4c3f-86c9-b07816f91a72-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-2e88cb12-a428-4c3f-86c9-b07816f91a72-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "cinder-quobyte-2e88cb12-a428-4c3f-86c9-b07816f91a72" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:26:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-quobyte-2e88cb12-a428-4c3f-86c9-b07816f91a72" acquired by "delete_volume" :: waited 0.016s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:26:20 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e4a60b-263e-41ea-9c9c-563f67c1fd18]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:20 devstack sudo[112935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72 Jun 25 18:26:20 devstack sudo[112935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:20 devstack sudo[112933]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.836s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:20 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:26:20 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Deleted volume successfully. Jun 25 18:26:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-3cc5a008-726f-4d6c-9b12-c5dc26a17691 tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-83c4b7d2-65f3-4e54-a370-6dbb4140866d-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:21 devstack sudo[112935]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72" returned: 0 in 0.814s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:21 devstack sudo[112941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72 Jun 25 18:26:21 devstack sudo[112941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:21 devstack sudo[112941]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2e88cb12-a428-4c3f-86c9-b07816f91a72" returned: 0 in 0.748s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:21 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-quobyte-2e88cb12-a428-4c3f-86c9-b07816f91a72" released by "delete_volume" :: held 1.613s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:22 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Created reservations ['c4573269-da2e-4d47-a1a1-536303c73bae', '90b5bc0c-b0f8-4847-a719-7ca301766a5b', 'eace9803-3ac9-4d0b-b14f-bb59eb1715fd', 'c7cc9039-e364-4162-a23c-9524f6a99269'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:26:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:22 devstack sudo[112944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:26:22 devstack sudo[112944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:22 devstack sudo[112944]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.773s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:22 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:26:22 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Deleted volume successfully. Jun 25 18:26:22 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-46fcaefd-865a-48f2-bcfc-aa4c37834337 tempest-SnapshotDependencyTests-818739072 None] Lock "cinder-2e88cb12-a428-4c3f-86c9-b07816f91a72-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:26:33 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=22,cinder:INSERT=9,cinder:DELETE=3,cinder:SELECT=21 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:26:33 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=27,cinder:UPDATE=35,cinder:DELETE=2,cinder:INSERT=5 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Flow 'volume_create_manager' (b5e2f0e1-24e3-417a-aa4a-b1b3dd1db017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fea0bcd-b0e9-4a90-9219-095bbeff5f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fea0bcd-b0e9-4a90-9219-095bbeff5f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-393191380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd98bea-1eb3-4f12-ae69-09e90ed6caea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394cc8f409b3420fb3a618300263ba02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:26:35Z,use_quota=True,user_id='9282b1bb0e534cd4a619b7709bed3f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09234c89-2774-427a-a253-301a2456b257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09234c89-2774-427a-a253-301a2456b257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebaa2883-05ac-496c-a866-ddb15e0deea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebaa2883-05ac-496c-a866-ddb15e0deea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd98bea-1eb3-4f12-ae69-09e90ed6caea', 'volume_name': 'volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e3f692-84b8-4bcc-8679-6a88864a53cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e3f692-84b8-4bcc-8679-6a88864a53cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33d37e7-9e18-472b-b361-a3b3327cdbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:34 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Volume 3bd98bea-1eb3-4f12-ae69-09e90ed6caea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea', 'volume_size': 1} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-393191380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd98bea-1eb3-4f12-ae69-09e90ed6caea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394cc8f409b3420fb3a618300263ba02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:26:35Z,use_quota=True,user_id='9282b1bb0e534cd4a619b7709bed3f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Creating volume 3bd98bea-1eb3-4f12-ae69-09e90ed6caea {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:26:35 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:26:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:35 devstack sudo[113115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea 1073741824 Jun 25 18:26:35 devstack sudo[113115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:35 devstack sudo[113115]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea 1073741824" returned: 0 in 0.889s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:35 devstack sudo[113120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea Jun 25 18:26:35 devstack sudo[113120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:36 devstack sudo[113120]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea" returned: 0 in 0.660s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:26:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33d37e7-9e18-472b-b361-a3b3327cdbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb529c1-df07-44a4-8eb9-98939df0464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:26:36 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Volume volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea (3bd98bea-1eb3-4f12-ae69-09e90ed6caea): created successfully Jun 25 18:26:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb529c1-df07-44a4-8eb9-98939df0464a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:26:36 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Flow 'volume_create_manager' (b5e2f0e1-24e3-417a-aa4a-b1b3dd1db017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:26:36 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4f8409f3-b3c1-4cef-a7ea-a011e9afb6b8 tempest-TestMinimumBasicScenario-390504541 None] Created volume successfully. Jun 25 18:26:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:26:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:26:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:26:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:39 devstack sudo[113127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:26:39 devstack sudo[113127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:40 devstack sudo[113127]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.786s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:26:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:26:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 28 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:26:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:26:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-125d7c0e-8ff9-4372-8702-73ca3e4628c8 req-4f1a19fc-48f7-40b9-b80d-000a441b3412 tempest-TestMinimumBasicScenario-390504541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:26:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-125d7c0e-8ff9-4372-8702-73ca3e4628c8 req-4f1a19fc-48f7-40b9-b80d-000a441b3412 tempest-TestMinimumBasicScenario-390504541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:26:40 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b026a0-6fd5-4b29-a5f2-c6b319879603]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:26:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-125d7c0e-8ff9-4372-8702-73ca3e4628c8 req-4f1a19fc-48f7-40b9-b80d-000a441b3412 tempest-TestMinimumBasicScenario-390504541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:26:40 devstack sudo[113138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea Jun 25 18:26:40 devstack sudo[113138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:26:41 devstack sudo[113138]: pam_unix(sudo:session): session closed for user root Jun 25 18:26:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [req-125d7c0e-8ff9-4372-8702-73ca3e4628c8 req-4f1a19fc-48f7-40b9-b80d-000a441b3412 tempest-TestMinimumBasicScenario-390504541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea" returned: 0 in 0.811s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:26:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [req-125d7c0e-8ff9-4372-8702-73ca3e4628c8 req-4f1a19fc-48f7-40b9-b80d-000a441b3412 tempest-TestMinimumBasicScenario-390504541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.830s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:26:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-125d7c0e-8ff9-4372-8702-73ca3e4628c8 req-4f1a19fc-48f7-40b9-b80d-000a441b3412 tempest-TestMinimumBasicScenario-390504541 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139', 'name': 'volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61165181-f3fb-470d-99b2-31a766249e2d', 'enforce_multipath': True} {{(pid=93651) _connection_create /opt/stack/cinder/cinder/volume/manager.py:5279}} Jun 25 18:26:41 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-125d7c0e-8ff9-4372-8702-73ca3e4628c8 req-4f1a19fc-48f7-40b9-b80d-000a441b3412 tempest-TestMinimumBasicScenario-390504541 None] attachment_update completed successfully. Jun 25 18:26:51 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:26:51 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=6,cinder:SELECT=9,cinder:INSERT=1 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:27:29 devstack cinder-volume[93651]: INFO cinder.volume.manager [req-71bb9f56-57f8-4fe1-bee4-1d9698158a08 req-c9cdb9e6-ce62-4702-8174-3306a1d10d64 tempest-TestMinimumBasicScenario-390504541 None] Terminate volume connection completed successfully. Jun 25 18:27:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [req-71bb9f56-57f8-4fe1-bee4-1d9698158a08 req-c9cdb9e6-ce62-4702-8174-3306a1d10d64 tempest-TestMinimumBasicScenario-390504541 None] Deleting attachment 61165181-f3fb-470d-99b2-31a766249e2d. {{(pid=93651) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5410}} Jun 25 18:27:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Acquiring lock "cinder-3bd98bea-1eb3-4f12-ae69-09e90ed6caea-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:27:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Lock "cinder-3bd98bea-1eb3-4f12-ae69-09e90ed6caea-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:27:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Acquiring lock "cinder-quobyte-3bd98bea-1eb3-4f12-ae69-09e90ed6caea" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:27:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Lock "cinder-quobyte-3bd98bea-1eb3-4f12-ae69-09e90ed6caea" acquired by "delete_volume" :: waited 0.016s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:27:31 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[67da4d33-06cc-4566-9605-c049695336b8]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:27:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:27:31 devstack sudo[113734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea Jun 25 18:27:31 devstack sudo[113734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:27:31 devstack sudo[113734]: pam_unix(sudo:session): session closed for user root Jun 25 18:27:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea" returned: 0 in 0.779s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:27:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:27:31 devstack sudo[113774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea Jun 25 18:27:31 devstack sudo[113774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:27:32 devstack sudo[113774]: pam_unix(sudo:session): session closed for user root Jun 25 18:27:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-3bd98bea-1eb3-4f12-ae69-09e90ed6caea" returned: 0 in 0.674s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:27:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Lock "cinder-quobyte-3bd98bea-1eb3-4f12-ae69-09e90ed6caea" released by "delete_volume" :: held 1.494s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:27:32 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Created reservations ['0300c627-e50b-4002-b90d-c06ee5dcf527', 'f3d8c567-3d00-43d9-aea8-8614b1b7ed6b', 'c8b00651-2476-4094-9a9c-0f94646a0847', '8615929b-149c-4718-8f5a-f47a6206f2cf'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:27:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:27:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:27:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:27:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:27:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:27:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:27:32 devstack sudo[113779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:27:32 devstack sudo[113779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:27:33 devstack sudo[113779]: pam_unix(sudo:session): session closed for user root Jun 25 18:27:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.687s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:27:33 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:27:33 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Deleted volume successfully. Jun 25 18:27:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-cbd286b4-2430-4097-99eb-1c15727f0e62 tempest-TestMinimumBasicScenario-390504541 None] Lock "cinder-3bd98bea-1eb3-4f12-ae69-09e90ed6caea-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:27:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:27:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:27:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:27:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:27:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:27:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:27:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:27:39 devstack sudo[113837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:27:39 devstack sudo[113837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:27:39 devstack sudo[113837]: pam_unix(sudo:session): session closed for user root Jun 25 18:27:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.667s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:27:39 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:27:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:27:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 28 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:27:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:27:42 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:27:43 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Flow 'volume_create_manager' (e48fd9b7-95b8-4be2-8349-312876d0edc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecd73c2-6980-4dcb-b632-0e809d09fef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecd73c2-6980-4dcb-b632-0e809d09fef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-49605219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4937cb89-0947-4363-aca8-455af8a6dd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88915379bc114986883e39f18258cc3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:03Z,use_quota=True,user_id='0abf60eb742e4cd299f6483322847034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13cc168-b95a-491f-b3b0-13ca3c40197c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13cc168-b95a-491f-b3b0-13ca3c40197c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94d3988-b60e-4000-b327-033e490eaee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94d3988-b60e-4000-b327-033e490eaee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4937cb89-0947-4363-aca8-455af8a6dd40', 'volume_name': 'volume-4937cb89-0947-4363-aca8-455af8a6dd40', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65bc479b-3f4f-405d-af50-9ec06de94209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65bc479b-3f4f-405d-af50-9ec06de94209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd14dbf4-77af-44ef-80c9-17a01764633d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Volume 4937cb89-0947-4363-aca8-455af8a6dd40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4937cb89-0947-4363-aca8-455af8a6dd40', 'volume_size': 1} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-49605219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4937cb89-0947-4363-aca8-455af8a6dd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88915379bc114986883e39f18258cc3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:03Z,use_quota=True,user_id='0abf60eb742e4cd299f6483322847034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Creating volume 4937cb89-0947-4363-aca8-455af8a6dd40 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:03 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:03 devstack sudo[113897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 1073741824 Jun 25 18:28:03 devstack sudo[113897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Flow 'volume_create_manager' (6e25119f-fa1d-4225-bb0e-0aa98d4ab15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f746aa4c-2f73-4122-b4b4-1bf4af24ed3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f746aa4c-2f73-4122-b4b4-1bf4af24ed3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270184787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c73e9f-f1d4-4cc6-adec-872dc6378ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a962b635e8744494ac7afeae1da63351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:03Z,use_quota=True,user_id='f3a7bc0e01424fb683054ce308271ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9ed74b-2ecc-4673-b585-31bc95ab3719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9ed74b-2ecc-4673-b585-31bc95ab3719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e960125-f051-41eb-959d-c871e6f59d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e960125-f051-41eb-959d-c871e6f59d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96c73e9f-f1d4-4cc6-adec-872dc6378ee0', 'volume_name': 'volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b3781b-ea49-487d-9ade-93f894aadac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b3781b-ea49-487d-9ade-93f894aadac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd53e082-7de9-48a1-a23c-7cde7836e70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Volume 96c73e9f-f1d4-4cc6-adec-872dc6378ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0', 'volume_size': 1} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Flow 'volume_create_manager' (e26279cc-7740-4b85-a198-1f52a38a7c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f6ed3b-fc02-47af-8e03-394a00967356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f6ed3b-fc02-47af-8e03-394a00967356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-663017275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b6f54e-3d02-48b2-a2c5-dd747a8926e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a962b635e8744494ac7afeae1da63351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:03Z,use_quota=True,user_id='f3a7bc0e01424fb683054ce308271ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a276a95-8187-4daf-994a-ed938036efff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a276a95-8187-4daf-994a-ed938036efff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84564bc4-6e65-4b74-83d2-814030b88e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84564bc4-6e65-4b74-83d2-814030b88e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b6f54e-3d02-48b2-a2c5-dd747a8926e0', 'volume_name': 'volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3893b0aa-1e41-4e30-a9f6-7bb0785eed2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3893b0aa-1e41-4e30-a9f6-7bb0785eed2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca743beb-73e4-4e19-a814-96e28c931e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:03 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Volume 89b6f54e-3d02-48b2-a2c5-dd747a8926e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0', 'volume_size': 1} Jun 25 18:28:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Flow 'volume_create_manager' (ef383ebd-69d9-435f-8786-26bcbc1b96e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596e16e8-71e1-42eb-8a9c-ecd18d67000a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596e16e8-71e1-42eb-8a9c-ecd18d67000a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-576172662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5845a9ba-32ba-4322-b16a-7a27652699a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e974428dab64df7abb38e2a3e921add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:04Z,use_quota=True,user_id='c7d984947c024942b9032be45702f81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5350356b-e6e1-421f-9d16-4d3c79be6c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5350356b-e6e1-421f-9d16-4d3c79be6c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7362b966-7543-4c86-a413-3f25b465f5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7362b966-7543-4c86-a413-3f25b465f5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5845a9ba-32ba-4322-b16a-7a27652699a6', 'volume_name': 'volume-5845a9ba-32ba-4322-b16a-7a27652699a6', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5f8cec-ae54-4940-afdb-c31cfb17cfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5f8cec-ae54-4940-afdb-c31cfb17cfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0375a109-1e70-4bb8-9475-5cd9669d9413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume 5845a9ba-32ba-4322-b16a-7a27652699a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5845a9ba-32ba-4322-b16a-7a27652699a6', 'volume_size': 1} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Flow 'volume_create_manager' (424e297f-574e-4504-8b49-02f72b89a9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1fa4f4-e216-4910-9cdd-cf7d45a7a5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1fa4f4-e216-4910-9cdd-cf7d45a7a5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-694790918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1f0076-a507-4cc5-9a33-3ae47710a3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a962b635e8744494ac7afeae1da63351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:04Z,use_quota=True,user_id='f3a7bc0e01424fb683054ce308271ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa482f29-9873-479e-899a-9700404445cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa482f29-9873-479e-899a-9700404445cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e767facb-68ee-4ffa-bcf2-3419c899bf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e767facb-68ee-4ffa-bcf2-3419c899bf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec1f0076-a507-4cc5-9a33-3ae47710a3c6', 'volume_name': 'volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5e1365-75f4-4eea-9308-4b17089bbf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5e1365-75f4-4eea-9308-4b17089bbf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24cb2516-1bec-49a1-b6c7-7b8b40601daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Volume ec1f0076-a507-4cc5-9a33-3ae47710a3c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6', 'volume_size': 1} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Flow 'volume_create_manager' (6649309a-f05e-4b8c-bd04-2d665b183c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a141d2cb-6181-4fc1-8c62-eb786582ebfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a141d2cb-6181-4fc1-8c62-eb786582ebfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-249415306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a962b635e8744494ac7afeae1da63351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:04Z,use_quota=True,user_id='f3a7bc0e01424fb683054ce308271ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5337d38f-1dec-4df8-9377-ff470615a6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5337d38f-1dec-4df8-9377-ff470615a6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0045964-4ddc-4274-8443-428c19755e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0045964-4ddc-4274-8443-428c19755e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a5729c-fd0e-4e5d-bee3-f9c6019b81ac', 'volume_name': 'volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df88ceb5-1662-4bfb-8233-9a223afa2d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df88ceb5-1662-4bfb-8233-9a223afa2d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d9c3b3-9543-4f9e-b899-36dab1ecacea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Volume d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac', 'volume_size': 1} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:04 devstack sudo[113897]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 1073741824" returned: 0 in 1.270s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:04 devstack sudo[113903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 Jun 25 18:28:04 devstack sudo[113903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Flow 'volume_create_manager' (cef7dbfd-4efa-4bce-93e8-f684d1f70457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e83979-3181-4899-b8bc-128ebafcf633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e83979-3181-4899-b8bc-128ebafcf633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-163936320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6954f49f-f65a-42d9-8d08-f6bd9ebf5de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a962b635e8744494ac7afeae1da63351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:05Z,use_quota=True,user_id='f3a7bc0e01424fb683054ce308271ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f3b45a-46e0-42e0-a041-a41d1d35209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f3b45a-46e0-42e0-a041-a41d1d35209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93d98bf-5661-48ce-8d30-53a43fc8d58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93d98bf-5661-48ce-8d30-53a43fc8d58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6954f49f-f65a-42d9-8d08-f6bd9ebf5de4', 'volume_name': 'volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d2de06-b8ce-4513-a275-6b53009820ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d2de06-b8ce-4513-a275-6b53009820ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f5dc3a-8d06-4f2a-be26-1a8ae7674a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:04 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Volume 6954f49f-f65a-42d9-8d08-f6bd9ebf5de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4', 'volume_size': 1} Jun 25 18:28:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:05 devstack sudo[113903]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40" returned: 0 in 0.691s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.799s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270184787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c73e9f-f1d4-4cc6-adec-872dc6378ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a962b635e8744494ac7afeae1da63351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:03Z,use_quota=True,user_id='f3a7bc0e01424fb683054ce308271ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Creating volume 96c73e9f-f1d4-4cc6-adec-872dc6378ee0 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:05 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd14dbf4-77af-44ef-80c9-17a01764633d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4937cb89-0947-4363-aca8-455af8a6dd40', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:05 devstack sudo[113906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0 1073741824 Jun 25 18:28:05 devstack sudo[113906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc70d66-ec5f-42c3-b85c-bfbe54e34de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:05 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Volume volume-4937cb89-0947-4363-aca8-455af8a6dd40 (4937cb89-0947-4363-aca8-455af8a6dd40): created successfully Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc70d66-ec5f-42c3-b85c-bfbe54e34de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:05 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Flow 'volume_create_manager' (e48fd9b7-95b8-4be2-8349-312876d0edc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:05 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-193f503b-9359-47e8-b313-79589c8b75f2 tempest-VolumeDependencyTests-615744048 None] Created volume successfully. Jun 25 18:28:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:06 devstack sudo[113906]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0 1073741824" returned: 0 in 0.980s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:06 devstack sudo[113912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0 Jun 25 18:28:06 devstack sudo[113912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:07 devstack sudo[113912]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0" returned: 0 in 0.644s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.358s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-663017275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b6f54e-3d02-48b2-a2c5-dd747a8926e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a962b635e8744494ac7afeae1da63351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:03Z,use_quota=True,user_id='f3a7bc0e01424fb683054ce308271ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Creating volume 89b6f54e-3d02-48b2-a2c5-dd747a8926e0 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:07 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd53e082-7de9-48a1-a23c-7cde7836e70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:07 devstack sudo[113915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0 1073741824 Jun 25 18:28:07 devstack sudo[113915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f066ad-dc29-4ae6-97e1-c51aad517947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:07 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Volume volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0 (96c73e9f-f1d4-4cc6-adec-872dc6378ee0): created successfully Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f066ad-dc29-4ae6-97e1-c51aad517947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Flow 'volume_create_manager' (6e25119f-fa1d-4225-bb0e-0aa98d4ab15b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:07 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-074640db-e9ee-4215-9808-7027ae94ddff tempest-CreateVolumesFromImageTest-965324833 None] Created volume successfully. Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Flow 'volume_create_manager' (403b2693-2c88-4e56-b646-40d0031eafd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e64f006-fbd3-4b8a-bd19-5340dd81cb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e64f006-fbd3-4b8a-bd19-5340dd81cb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb845a4d-b0fe-4964-95cf-acdb0fa62d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8049cd976dff4c869837db7982a075d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:07Z,use_quota=True,user_id='53b04f754d82463f8342a356a4cc2784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d534b64a-4e66-4e62-af69-b4e95cf93401),volume_type_id=d534b64a-4e66-4e62-af69-b4e95cf93401)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a3fac1-4767-4d16-b4bd-541445bad279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a3fac1-4767-4d16-b4bd-541445bad279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d28c668-f07c-4f8d-9f7e-b92ec09fb88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.image.glance [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Creating Keystone auth plugin from conf {{(pid=93651) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d28c668-f07c-4f8d-9f7e-b92ec09fb88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb845a4d-b0fe-4964-95cf-acdb0fa62d83', 'volume_name': 'volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83', 'volume_size': 1, 'image_id': 'a601dcf8-e00a-4352-a265-f32010778f4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a601dcf8-e00a-4352-a265-f32010778f4d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2423ead9014f96cd9ee181df5baa104a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8049cd976dff4c869837db7982a075d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4d33357b7aab714681341ca673bdcee64f71442c98816527239c55a600174077bfc62c7ed53e9f3b8c16ce50061d27d0ea1d50b11cd015f212e4aa293ba400a0', 'id': 'a601dcf8-e00a-4352-a265-f32010778f4d', 'created_at': datetime.datetime(2026, 6, 25, 16, 28, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 28, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a601dcf8-e00a-4352-a265-f32010778f4d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace33c16-81a1-4dd8-91d4-8c45ebf666ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace33c16-81a1-4dd8-91d4-8c45ebf666ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f4253f-7908-4b0d-80f6-a36eedf3718a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:07 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Volume cb845a4d-b0fe-4964-95cf-acdb0fa62d83: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83', 'volume_size': 1, 'image_id': 'a601dcf8-e00a-4352-a265-f32010778f4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a601dcf8-e00a-4352-a265-f32010778f4d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2423ead9014f96cd9ee181df5baa104a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8049cd976dff4c869837db7982a075d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4d33357b7aab714681341ca673bdcee64f71442c98816527239c55a600174077bfc62c7ed53e9f3b8c16ce50061d27d0ea1d50b11cd015f212e4aa293ba400a0', 'id': 'a601dcf8-e00a-4352-a265-f32010778f4d', 'created_at': datetime.datetime(2026, 6, 25, 16, 28, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 28, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a601dcf8-e00a-4352-a265-f32010778f4d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Trying to clone cb845a4d-b0fe-4964-95cf-acdb0fa62d83 from image a601dcf8-e00a-4352-a265-f32010778f4d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a601dcf8-e00a-4352-a265-f32010778f4d', 'metadata': {}}]). {{(pid=93651) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:28:07 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Image download 0.00 MB at 0.00 MB/s Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f142316-d4cd-4dab-9a0b-a002c70ea3fe]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:08 devstack sudo[113915]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0 1073741824" returned: 0 in 0.964s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:08 devstack sudo[113921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD Jun 25 18:28:08 devstack sudo[113921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:08 devstack sudo[113923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0 Jun 25 18:28:08 devstack sudo[113923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:08 devstack sudo[113921]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:08 devstack sudo[113923]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0" returned: 0 in 0.686s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.620s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-576172662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5845a9ba-32ba-4322-b16a-7a27652699a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e974428dab64df7abb38e2a3e921add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:04Z,use_quota=True,user_id='c7d984947c024942b9032be45702f81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Creating volume 5845a9ba-32ba-4322-b16a-7a27652699a6 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:08 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5845a9ba-32ba-4322-b16a-7a27652699a6 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca743beb-73e4-4e19-a814-96e28c931e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df635c18-8ec8-41b2-ba11-7d2921e94aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:08 devstack sudo[113930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5845a9ba-32ba-4322-b16a-7a27652699a6 1073741824 Jun 25 18:28:08 devstack sudo[113930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:08 devstack sudo[113929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD Jun 25 18:28:08 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Volume volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0 (89b6f54e-3d02-48b2-a2c5-dd747a8926e0): created successfully Jun 25 18:28:08 devstack sudo[113929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df635c18-8ec8-41b2-ba11-7d2921e94aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:08 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Flow 'volume_create_manager' (e26279cc-7740-4b85-a198-1f52a38a7c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:08 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-519b12c9-ea4b-40a7-bade-8628b7bddd21 tempest-CreateVolumesFromImageTest-965324833 None] Created volume successfully. Jun 25 18:28:09 devstack sudo[113929]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD" returned: 1 in 0.755s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:28:09 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Temporary image a601dcf8-e00a-4352-a265-f32010778f4d is fetched for user 53b04f754d82463f8342a356a4cc2784. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:28:09 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[8845cf05-9069-4d7e-b2a7-a1ed492c08ec]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:09 devstack sudo[113940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD Jun 25 18:28:09 devstack sudo[113940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:09 devstack sudo[113930]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5845a9ba-32ba-4322-b16a-7a27652699a6 1073741824" returned: 0 in 0.916s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5845a9ba-32ba-4322-b16a-7a27652699a6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:09 devstack sudo[113943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5845a9ba-32ba-4322-b16a-7a27652699a6 Jun 25 18:28:09 devstack sudo[113943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:10 devstack sudo[113940]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:10 devstack sudo[113947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD Jun 25 18:28:10 devstack sudo[113947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:10 devstack sudo[113943]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5845a9ba-32ba-4322-b16a-7a27652699a6" returned: 0 in 0.675s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.944s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-694790918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1f0076-a507-4cc5-9a33-3ae47710a3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a962b635e8744494ac7afeae1da63351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:04Z,use_quota=True,user_id='f3a7bc0e01424fb683054ce308271ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Creating volume ec1f0076-a507-4cc5-9a33-3ae47710a3c6 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:10 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0375a109-1e70-4bb8-9475-5cd9669d9413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5845a9ba-32ba-4322-b16a-7a27652699a6', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:10 devstack sudo[113950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6 1073741824 Jun 25 18:28:10 devstack sudo[113950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0601aa25-f8a5-4123-aadc-4cfc726dcb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:10 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume volume-5845a9ba-32ba-4322-b16a-7a27652699a6 (5845a9ba-32ba-4322-b16a-7a27652699a6): created successfully Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0601aa25-f8a5-4123-aadc-4cfc726dcb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Flow 'volume_create_manager' (ef383ebd-69d9-435f-8786-26bcbc1b96e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-14f43090-ed0f-44b5-ab36-7cd03ab08018 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Created volume successfully. Jun 25 18:28:10 devstack sudo[113947]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD" returned: 1 in 0.727s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:28:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:11 devstack sudo[113950]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6 1073741824" returned: 0 in 0.869s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:11 devstack sudo[113959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6 Jun 25 18:28:11 devstack sudo[113959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:11 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Flow 'volume_create_manager' (74b5e551-e6ef-4128-a78d-5b4cc1798cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180d2888-25e4-4c45-b802-d0fa1b8a2457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180d2888-25e4-4c45-b802-d0fa1b8a2457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256754380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a56017e-360d-4f9c-8afe-bbe8df3fc6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e974428dab64df7abb38e2a3e921add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:12Z,use_quota=True,user_id='c7d984947c024942b9032be45702f81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc0d282-0381-48b9-94b7-28b0cb32b500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc0d282-0381-48b9-94b7-28b0cb32b500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148e62fd-6a16-448f-ace5-e7e0346cb6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148e62fd-6a16-448f-ace5-e7e0346cb6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a56017e-360d-4f9c-8afe-bbe8df3fc6ea', 'volume_name': 'volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d5a238-9c8e-4981-bf9c-3b00bfbcd259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d5a238-9c8e-4981-bf9c-3b00bfbcd259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ef323e-3c6b-46af-843f-e55d8650ac4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:11 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume 2a56017e-360d-4f9c-8afe-bbe8df3fc6ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea', 'volume_size': 1} Jun 25 18:28:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:12 devstack sudo[113959]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6" returned: 0 in 0.711s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.439s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-249415306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a962b635e8744494ac7afeae1da63351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:04Z,use_quota=True,user_id='f3a7bc0e01424fb683054ce308271ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Creating volume d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:12 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:12 devstack sudo[113962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac 1073741824 Jun 25 18:28:12 devstack sudo[113962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24cb2516-1bec-49a1-b6c7-7b8b40601daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dbd1938-88e9-44ad-9b0d-03b9d8435113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Flow 'volume_create_manager' (53f66343-7e46-426f-8291-fdcc4c12ff5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd51d5b-9f58-4104-9435-fef56f1c65ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:12 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Volume volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6 (ec1f0076-a507-4cc5-9a33-3ae47710a3c6): created successfully Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dbd1938-88e9-44ad-9b0d-03b9d8435113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Flow 'volume_create_manager' (424e297f-574e-4504-8b49-02f72b89a9a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd51d5b-9f58-4104-9435-fef56f1c65ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1122993154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5957c8-1a61-49d0-ad44-d7da8bfeab10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e974428dab64df7abb38e2a3e921add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:12Z,use_quota=True,user_id='c7d984947c024942b9032be45702f81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde869df-6305-4bac-97c9-c4dde2df4d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde869df-6305-4bac-97c9-c4dde2df4d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf1135a-ebf7-417d-a641-08b2d01badeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf1135a-ebf7-417d-a641-08b2d01badeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5957c8-1a61-49d0-ad44-d7da8bfeab10', 'volume_name': 'volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed7aef1-07ae-428f-9c25-6f76ee464911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed7aef1-07ae-428f-9c25-6f76ee464911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794048f3-c5b6-46d9-96ad-3decd7dbd23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:12 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume da5957c8-1a61-49d0-ad44-d7da8bfeab10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10', 'volume_size': 1} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:12 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-8ac8a7b7-3094-407a-b8f3-6b775af3e3f8 tempest-CreateVolumesFromImageTest-965324833 None] Created volume successfully. Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Flow 'volume_create_manager' (32c469c3-6615-41ed-a0f3-6c22e9821912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3759a5b-7fe1-48cf-a259-a58a92000f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3759a5b-7fe1-48cf-a259-a58a92000f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1071688406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0b5ac2-b955-4e5d-bd6c-2483718a1107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e974428dab64df7abb38e2a3e921add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:12Z,use_quota=True,user_id='c7d984947c024942b9032be45702f81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cc014e-65a1-478d-9a13-7e104061d467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cc014e-65a1-478d-9a13-7e104061d467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee864e55-1b2f-4fc1-8d54-ae6a8471e93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee864e55-1b2f-4fc1-8d54-ae6a8471e93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0b5ac2-b955-4e5d-bd6c-2483718a1107', 'volume_name': 'volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea17dbd-16c4-4c27-9177-83d4d1dd04b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea17dbd-16c4-4c27-9177-83d4d1dd04b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b90570-51b0-43c1-ba41-cc1fbf207e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:12 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume 2f0b5ac2-b955-4e5d-bd6c-2483718a1107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107', 'volume_size': 1} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Flow 'volume_create_manager' (c31a41d6-0b32-44ca-84d4-5aeceeabecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922261fc-3947-4aae-9d6a-585900f361bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:12 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922261fc-3947-4aae-9d6a-585900f361bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147603874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddea7d56-9e40-40a2-8f75-df0f25e5c59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e974428dab64df7abb38e2a3e921add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:13Z,use_quota=True,user_id='c7d984947c024942b9032be45702f81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c0130e-fc76-45c2-bf64-ce0a99373662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c0130e-fc76-45c2-bf64-ce0a99373662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74676aef-3c18-449b-b13b-7e601a1d5ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74676aef-3c18-449b-b13b-7e601a1d5ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddea7d56-9e40-40a2-8f75-df0f25e5c59a', 'volume_name': 'volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d35ed2-2049-4484-81e9-76f5d3a935de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d35ed2-2049-4484-81e9-76f5d3a935de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e91f6a-bef1-4cd1-965f-be761b355e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:13 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume ddea7d56-9e40-40a2-8f75-df0f25e5c59a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a', 'volume_size': 1} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:13 devstack sudo[113962]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac 1073741824" returned: 0 in 1.026s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:13 devstack sudo[113967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac Jun 25 18:28:13 devstack sudo[113967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Flow 'volume_create_manager' (c3718cb8-b229-4aa1-9b68-94ca0612366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ebbcfb-5024-41b5-8a2f-f35e2adaec2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ebbcfb-5024-41b5-8a2f-f35e2adaec2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2139201078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34241c20-53ea-4b58-9929-9b33f4996d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e974428dab64df7abb38e2a3e921add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:13Z,use_quota=True,user_id='c7d984947c024942b9032be45702f81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac74a99a-a38c-445d-89c9-29266457f904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac74a99a-a38c-445d-89c9-29266457f904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1177568c-e1fb-4436-8a47-a4af5ccbccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1177568c-e1fb-4436-8a47-a4af5ccbccdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34241c20-53ea-4b58-9929-9b33f4996d31', 'volume_name': 'volume-34241c20-53ea-4b58-9929-9b33f4996d31', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f58489-9ca4-4037-b91f-f7abba75f142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f58489-9ca4-4037-b91f-f7abba75f142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc21eda-b800-4ac7-8d37-cf9da6e16112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:13 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume 34241c20-53ea-4b58-9929-9b33f4996d31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34241c20-53ea-4b58-9929-9b33f4996d31', 'volume_size': 1} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:13 devstack sudo[113967]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac" returned: 0 in 0.681s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.912s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-163936320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6954f49f-f65a-42d9-8d08-f6bd9ebf5de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a962b635e8744494ac7afeae1da63351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:05Z,use_quota=True,user_id='f3a7bc0e01424fb683054ce308271ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Creating volume 6954f49f-f65a-42d9-8d08-f6bd9ebf5de4 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:13 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d9c3b3-9543-4f9e-b899-36dab1ecacea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3923894c-dbe2-4c66-85f9-77f996d8496a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:13 devstack sudo[113970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4 1073741824 Jun 25 18:28:13 devstack sudo[113970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:13 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Volume volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac (d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac): created successfully Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3923894c-dbe2-4c66-85f9-77f996d8496a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Flow 'volume_create_manager' (6649309a-f05e-4b8c-bd04-2d665b183c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:13 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7e0963f4-b862-4539-abeb-40836d21dc93 tempest-CreateVolumesFromImageTest-965324833 None] Created volume successfully. Jun 25 18:28:14 devstack sudo[113970]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4 1073741824" returned: 0 in 0.877s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:14 devstack sudo[113976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4 Jun 25 18:28:14 devstack sudo[113976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:15 devstack sudo[113976]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4" returned: 0 in 0.653s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.261s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f5dc3a-8d06-4f2a-be26-1a8ae7674a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5eb8a1-709a-40f8-8c56-b2b0f49de79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] Creating offline snapshot e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 of volume 4937cb89-0947-4363-aca8-455af8a6dd40 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:28:15 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Volume volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4 (6954f49f-f65a-42d9-8d08-f6bd9ebf5de4): created successfully Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5eb8a1-709a-40f8-8c56-b2b0f49de79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Flow 'volume_create_manager' (cef7dbfd-4efa-4bce-93e8-f684d1f70457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c276f118-1521-4c63-b57e-d865450f77d2]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:15 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ca7bd7fd-294a-4a3a-aa99-660b4f0edb52 tempest-CreateVolumesFromImageTest-965324833 None] Created volume successfully. Jun 25 18:28:15 devstack sudo[113979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 Jun 25 18:28:15 devstack sudo[113979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "cinder-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "cinder-quobyte-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-quobyte-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4" acquired by "delete_volume" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1b0a18-0ec9-42f6-91f7-06d7ab1c741a]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:15 devstack sudo[113981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4 Jun 25 18:28:15 devstack sudo[113981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:16 devstack sudo[113979]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40" returned: 0 in 0.766s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:16 devstack sudo[113986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 1G Jun 25 18:28:16 devstack sudo[113986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:16 devstack sudo[113981]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4" returned: 0 in 0.757s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:16 devstack sudo[113991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4 Jun 25 18:28:16 devstack sudo[113991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:17 devstack sudo[113986]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 1G" returned: 0 in 0.828s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4937cb89-0947-4363-aca8-455af8a6dd40 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:17 devstack sudo[113997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4937cb89-0947-4363-aca8-455af8a6dd40 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 Jun 25 18:28:17 devstack sudo[113997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:17 devstack sudo[113991]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4" returned: 0 in 0.672s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-quobyte-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4" released by "delete_volume" :: held 1.476s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Created reservations ['7c5c51d0-4db0-4651-a1c2-248075e1ad2a', 'fe0e457b-44a9-4689-847d-a99c4e25eaca', 'fe0aa2c8-5566-483b-90ae-b4d30467f792', 'ea54a39e-8746-428a-90fc-f11282970319'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:17 devstack sudo[113999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:17 devstack sudo[113999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:17 devstack sudo[113997]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4937cb89-0947-4363-aca8-455af8a6dd40 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3" returned: 0 in 0.728s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:17 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 is being set with open permissions: ugo+rw Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:17 devstack sudo[114004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 Jun 25 18:28:17 devstack sudo[114004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "cinder-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "cinder-quobyte-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-quobyte-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac" acquired by "delete_volume" :: waited 0.014s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:18 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[625f5ccd-0a13-4a99-bcbb-f0559bcd98c1]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:18 devstack sudo[113999]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.761s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:18 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:18 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Deleted volume successfully. Jun 25 18:28:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-80781a6b-74f0-4eac-9e28-0ba882e1e572 tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-6954f49f-f65a-42d9-8d08-f6bd9ebf5de4-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:18 devstack sudo[114007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac Jun 25 18:28:18 devstack sudo[114007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:18 devstack sudo[114004]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3" returned: 0 in 0.673s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:18 devstack sudo[114011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.info Jun 25 18:28:18 devstack sudo[114011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:18 devstack sudo[114007]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac" returned: 0 in 0.858s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:18 devstack sudo[114016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac Jun 25 18:28:18 devstack sudo[114016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:19 devstack sudo[114011]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.info" returned: 0 in 0.657s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:19 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.info is being set with open permissions: ugo+rw Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:19 devstack sudo[114019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.info Jun 25 18:28:19 devstack sudo[114019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:19 devstack sudo[114016]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac" returned: 0 in 0.775s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-quobyte-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac" released by "delete_volume" :: held 1.686s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Created reservations ['47c2c20e-583a-4686-be27-43a5cfc48aee', 'b92a143a-1683-4d92-bd4e-656e40fab108', 'e18cc732-d258-407a-819e-347450c8257f', '8670e597-9251-436a-88da-6d9479dd4c96'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:19 devstack sudo[114019]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.info" returned: 0 in 0.647s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.428s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.882s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb845a4d-b0fe-4964-95cf-acdb0fa62d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8049cd976dff4c869837db7982a075d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:07Z,use_quota=True,user_id='53b04f754d82463f8342a356a4cc2784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d534b64a-4e66-4e62-af69-b4e95cf93401),volume_type_id=d534b64a-4e66-4e62-af69-b4e95cf93401)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Creating volume cb845a4d-b0fe-4964-95cf-acdb0fa62d83 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:19 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:19 devstack sudo[114023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 1073741824 Jun 25 18:28:19 devstack sudo[114023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:19 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-c27257f1-afdf-4c05-9365-8c801e489bec tempest-VolumeDependencyTests-615744048 None] Create snapshot completed successfully Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:19 devstack sudo[114025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:19 devstack sudo[114025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "cinder-ec1f0076-a507-4cc5-9a33-3ae47710a3c6-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-ec1f0076-a507-4cc5-9a33-3ae47710a3c6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "cinder-quobyte-ec1f0076-a507-4cc5-9a33-3ae47710a3c6" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-quobyte-ec1f0076-a507-4cc5-9a33-3ae47710a3c6" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:20 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[5797782a-7db9-45f5-a65f-d68f33a303a7]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:20 devstack sudo[114027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6 Jun 25 18:28:20 devstack sudo[114027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:20 devstack sudo[114025]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.734s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:20 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:20 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Deleted volume successfully. Jun 25 18:28:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0a95e569-6450-4c5f-aba9-958f8cadd40d tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-d7a5729c-fd0e-4e5d-bee3-f9c6019b81ac-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:20 devstack sudo[114023]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 1073741824" returned: 0 in 0.917s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:20 devstack sudo[114034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 Jun 25 18:28:20 devstack sudo[114034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:21 devstack sudo[114027]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6" returned: 0 in 1.004s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:21 devstack sudo[114039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6 Jun 25 18:28:21 devstack sudo[114039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Flow 'volume_create_manager' (5aca99d3-3b1b-4cc0-ab06-fc17360d862d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2369fac6-ead4-4b8e-b0f7-0f8f10c90f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2369fac6-ead4-4b8e-b0f7-0f8f10c90f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-321784980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49556c8-0183-4a97-a4ea-1791381c6fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88915379bc114986883e39f18258cc3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:21Z,use_quota=True,user_id='0abf60eb742e4cd299f6483322847034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06a75bd-53c0-4c17-a15b-63d5101022d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06a75bd-53c0-4c17-a15b-63d5101022d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9198e277-a6b8-40b3-ae41-0b17928feada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9198e277-a6b8-40b3-ae41-0b17928feada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c49556c8-0183-4a97-a4ea-1791381c6fc0', 'volume_name': 'volume-c49556c8-0183-4a97-a4ea-1791381c6fc0', 'volume_size': 1, 'snapshot_id': 'e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574c516f-6b9c-4357-b092-7f699f538828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574c516f-6b9c-4357-b092-7f699f538828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e220cba7-ccfa-4425-a7a1-cc2c5b40a8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:21 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Volume c49556c8-0183-4a97-a4ea-1791381c6fc0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c49556c8-0183-4a97-a4ea-1791381c6fc0', 'volume_size': 1, 'snapshot_id': 'e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3'} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:21 devstack sudo[114034]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83" returned: 0 in 0.747s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.727s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256754380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a56017e-360d-4f9c-8afe-bbe8df3fc6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e974428dab64df7abb38e2a3e921add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:12Z,use_quota=True,user_id='c7d984947c024942b9032be45702f81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Creating volume 2a56017e-360d-4f9c-8afe-bbe8df3fc6ea {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:21 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:21 devstack sudo[114042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea 1073741824 Jun 25 18:28:21 devstack sudo[114042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Attempting download of a601dcf8-e00a-4352-a265-f32010778f4d ((None, [{'url': 'file:///opt/stack/data/glance/images/a601dcf8-e00a-4352-a265-f32010778f4d', 'metadata': {}}])) to volume cb845a4d-b0fe-4964-95cf-acdb0fa62d83. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0361e35-c981-498a-91fa-f48433aa0f79]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a601dcf8-e00a-4352-a265-f32010778f4d_4sgws_8w {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:21 devstack sudo[114044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a601dcf8-e00a-4352-a265-f32010778f4d_4sgws_8w Jun 25 18:28:21 devstack sudo[114044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:22 devstack sudo[114039]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ec1f0076-a507-4cc5-9a33-3ae47710a3c6" returned: 0 in 0.783s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-quobyte-ec1f0076-a507-4cc5-9a33-3ae47710a3c6" released by "delete_volume" :: held 1.852s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Created reservations ['471cc539-e94c-4499-89ff-d837882a04fc', '816b82a0-aaf2-431f-b446-68bb719c042b', 'f3b1b7b5-332b-4ce8-9ef1-812066c08031', 'dde24e9a-a75e-416f-a096-1dddf0d85598'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:22 devstack sudo[114050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:22 devstack sudo[114050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "cinder-89b6f54e-3d02-48b2-a2c5-dd747a8926e0-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-89b6f54e-3d02-48b2-a2c5-dd747a8926e0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:22 devstack sudo[114042]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:22 devstack sudo[114044]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea 1073741824" returned: 0 in 1.068s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a601dcf8-e00a-4352-a265-f32010778f4d_4sgws_8w" returned: 0 in 0.988s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a601dcf8-e00a-4352-a265-f32010778f4d_4sgws_8w {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "cinder-quobyte-89b6f54e-3d02-48b2-a2c5-dd747a8926e0" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-quobyte-89b6f54e-3d02-48b2-a2c5-dd747a8926e0" acquired by "delete_volume" :: waited 0.050s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f650aa-0a45-4ce3-acd1-6f102c142ff2]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:22 devstack sudo[114055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a601dcf8-e00a-4352-a265-f32010778f4d_4sgws_8w Jun 25 18:28:22 devstack sudo[114055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:22 devstack sudo[114057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea Jun 25 18:28:22 devstack sudo[114057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:22 devstack sudo[114056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0 Jun 25 18:28:23 devstack sudo[114056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:23 devstack sudo[114050]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.818s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:23 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Deleted volume successfully. Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-aa0e06e6-8770-4912-adda-0dfa9f0120f2 tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-ec1f0076-a507-4cc5-9a33-3ae47710a3c6-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:23 devstack sudo[114055]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a601dcf8-e00a-4352-a265-f32010778f4d_4sgws_8w" returned: 1 in 0.911s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a601dcf8-e00a-4352-a265-f32010778f4d_4sgws_8w' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc66f38-c3e7-4819-ba6c-64b64e3820c6]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:23 devstack sudo[114057]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea" returned: 0 in 0.864s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.399s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1122993154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5957c8-1a61-49d0-ad44-d7da8bfeab10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e974428dab64df7abb38e2a3e921add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:12Z,use_quota=True,user_id='c7d984947c024942b9032be45702f81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Creating volume da5957c8-1a61-49d0-ad44-d7da8bfeab10 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:23 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:23 devstack sudo[114065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD Jun 25 18:28:23 devstack sudo[114065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:23 devstack sudo[114070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10 1073741824 Jun 25 18:28:23 devstack sudo[114070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ef323e-3c6b-46af-843f-e55d8650ac4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1b2d6f-ecaf-45e1-ab83-30f91a993eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:23 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea (2a56017e-360d-4f9c-8afe-bbe8df3fc6ea): created successfully Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1b2d6f-ecaf-45e1-ab83-30f91a993eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Flow 'volume_create_manager' (74b5e551-e6ef-4128-a78d-5b4cc1798cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:23 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-978de981-fd74-4a49-8de8-80c33fe28c62 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Created volume successfully. Jun 25 18:28:23 devstack sudo[114056]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0" returned: 0 in 1.102s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:23 devstack sudo[114073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0 Jun 25 18:28:23 devstack sudo[114073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:24 devstack sudo[114065]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD" returned: 0 in 1.047s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:24 devstack sudo[114073]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-89b6f54e-3d02-48b2-a2c5-dd747a8926e0" returned: 0 in 0.845s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:24 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-quobyte-89b6f54e-3d02-48b2-a2c5-dd747a8926e0" released by "delete_volume" :: held 2.016s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:24 devstack sudo[114082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD Jun 25 18:28:24 devstack sudo[114082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:24 devstack sudo[114070]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10 1073741824" returned: 0 in 1.114s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:24 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Created reservations ['1b7b20c3-a35a-4e2f-b94d-472247b19d82', '889f0af6-cfd7-4150-861b-331a5c07d39c', '4ef35e31-18cc-4391-91c2-a331ceb3b1bb', '5dbfb53b-b55e-4155-9586-6f897242e121'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:24 devstack sudo[114084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10 Jun 25 18:28:24 devstack sudo[114084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:24 devstack sudo[114086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:24 devstack sudo[114086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:25 devstack sudo[114082]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD" returned: 1 in 0.973s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] a601dcf8-e00a-4352-a265-f32010778f4d was raw, converting to raw {{(pid=93651) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:25 devstack sudo[114084]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10" returned: 0 in 0.776s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.977s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1071688406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0b5ac2-b955-4e5d-bd6c-2483718a1107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e974428dab64df7abb38e2a3e921add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:12Z,use_quota=True,user_id='c7d984947c024942b9032be45702f81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Creating volume 2f0b5ac2-b955-4e5d-bd6c-2483718a1107 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:25 devstack sudo[114093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 Jun 25 18:28:25 devstack sudo[114093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:25 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794048f3-c5b6-46d9-96ad-3decd7dbd23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:25 devstack sudo[114095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107 1073741824 Jun 25 18:28:25 devstack sudo[114095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d6aaf8-3984-4cab-a8f3-a560de8426e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:25 devstack sudo[114086]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.770s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:25 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Deleted volume successfully. Jun 25 18:28:25 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10 (da5957c8-1a61-49d0-ad44-d7da8bfeab10): created successfully Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d6aaf8-3984-4cab-a8f3-a560de8426e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Flow 'volume_create_manager' (53f66343-7e46-426f-8291-fdcc4c12ff5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:25 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-3a371419-33db-4a47-8e8c-32d5b291eb81 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Created volume successfully. Jun 25 18:28:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-530acfe3-70ce-4ca3-be37-b69c343ce27a tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-89b6f54e-3d02-48b2-a2c5-dd747a8926e0-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "cinder-96c73e9f-f1d4-4cc6-adec-872dc6378ee0-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-96c73e9f-f1d4-4cc6-adec-872dc6378ee0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "cinder-quobyte-96c73e9f-f1d4-4cc6-adec-872dc6378ee0" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:26 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-quobyte-96c73e9f-f1d4-4cc6-adec-872dc6378ee0" acquired by "delete_volume" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:26 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d111ae-84c7-4f3d-a118-715480ea9583]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:26 devstack sudo[114097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0 Jun 25 18:28:26 devstack sudo[114097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:26 devstack sudo[114093]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83" returned: 0 in 1.020s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:26 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a601dcf8-e00a-4352-a265-f32010778f4d_lufbobzmdevstack@QuobyteHD, size 0.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:28:26 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Converted 0.00 MB image at 0.00 MB/s Jun 25 18:28:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:26 devstack sudo[114106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 1G Jun 25 18:28:26 devstack sudo[114106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:26 devstack sudo[114095]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107 1073741824" returned: 0 in 1.109s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:26 devstack sudo[114108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107 Jun 25 18:28:26 devstack sudo[114108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:27 devstack sudo[114097]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0" returned: 0 in 0.983s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:27 devstack sudo[114113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0 Jun 25 18:28:27 devstack sudo[114113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:27 devstack sudo[114106]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 1G" returned: 0 in 0.832s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f550bab-5844-4f97-9946-8a65cc3eddbb]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:27 devstack sudo[114119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 Jun 25 18:28:27 devstack sudo[114119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:27 devstack sudo[114108]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107" returned: 0 in 0.915s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.694s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147603874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddea7d56-9e40-40a2-8f75-df0f25e5c59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e974428dab64df7abb38e2a3e921add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:13Z,use_quota=True,user_id='c7d984947c024942b9032be45702f81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Creating volume ddea7d56-9e40-40a2-8f75-df0f25e5c59a {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:27 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b90570-51b0-43c1-ba41-cc1fbf207e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:27 devstack sudo[114121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a 1073741824 Jun 25 18:28:27 devstack sudo[114121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d05f0ce-9130-41f4-88d1-2f733bbb9e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:27 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107 (2f0b5ac2-b955-4e5d-bd6c-2483718a1107): created successfully Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d05f0ce-9130-41f4-88d1-2f733bbb9e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Flow 'volume_create_manager' (32c469c3-6615-41ed-a0f3-6c22e9821912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:27 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-1b82560d-9753-4b1e-a515-545bbfe5648e tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Created volume successfully. Jun 25 18:28:27 devstack sudo[114113]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-96c73e9f-f1d4-4cc6-adec-872dc6378ee0" returned: 0 in 0.798s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-quobyte-96c73e9f-f1d4-4cc6-adec-872dc6378ee0" released by "delete_volume" :: held 1.830s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:28 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Created reservations ['b5038834-380f-4068-92a6-3ce58c41adbe', 'd7ba609c-cfcb-4a4d-9cca-291a4c5204a7', 'b2cfdc27-55cf-487c-b8da-1c04d701a5c1', 'e4e7709a-1e0c-4ba1-9604-ef3db6fbeff3'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:28 devstack sudo[114124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:28 devstack sudo[114124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:28 devstack sudo[114119]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83" returned: 0 in 0.952s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:28 devstack sudo[114131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 Jun 25 18:28:28 devstack sudo[114131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:28 devstack sudo[114121]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a 1073741824" returned: 0 in 1.258s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:29 devstack sudo[114124]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.930s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:29 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Deleted volume successfully. Jun 25 18:28:29 devstack sudo[114136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a Jun 25 18:28:29 devstack sudo[114136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-18e6d3b6-a4b3-4974-9e28-1df729cf6c26 tempest-CreateVolumesFromImageTest-965324833 None] Lock "cinder-96c73e9f-f1d4-4cc6-adec-872dc6378ee0-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:29 devstack sudo[114131]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83" returned: 1 in 1.362s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Downloaded image a601dcf8-e00a-4352-a265-f32010778f4d ((None, [{'url': 'file:///opt/stack/data/glance/images/a601dcf8-e00a-4352-a265-f32010778f4d', 'metadata': {}}])) to volume cb845a4d-b0fe-4964-95cf-acdb0fa62d83 successfully. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Temporary image a601dcf8-e00a-4352-a265-f32010778f4d for user 53b04f754d82463f8342a356a4cc2784 is deleted. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Marking volume cb845a4d-b0fe-4964-95cf-acdb0fa62d83 as bootable. {{(pid=93651) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Copying metadata from image a601dcf8-e00a-4352-a265-f32010778f4d to cb845a4d-b0fe-4964-95cf-acdb0fa62d83. {{(pid=93651) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Creating volume glance metadata for volume cb845a4d-b0fe-4964-95cf-acdb0fa62d83 backed by image a601dcf8-e00a-4352-a265-f32010778f4d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a601dcf8-e00a-4352-a265-f32010778f4d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2423ead9014f96cd9ee181df5baa104a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93651) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:28:29 devstack sudo[114136]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f4253f-7908-4b0d-80f6-a36eedf3718a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83', 'volume_size': 1, 'image_id': 'a601dcf8-e00a-4352-a265-f32010778f4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a601dcf8-e00a-4352-a265-f32010778f4d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2423ead9014f96cd9ee181df5baa104a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8049cd976dff4c869837db7982a075d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4d33357b7aab714681341ca673bdcee64f71442c98816527239c55a600174077bfc62c7ed53e9f3b8c16ce50061d27d0ea1d50b11cd015f212e4aa293ba400a0', 'id': 'a601dcf8-e00a-4352-a265-f32010778f4d', 'created_at': datetime.datetime(2026, 6, 25, 16, 28, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 28, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a601dcf8-e00a-4352-a265-f32010778f4d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c318152a-f457-4f9f-9cc6-eba652a15774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a" returned: 0 in 0.931s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] <== create_volume: return (2259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.265s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.541s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2139201078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34241c20-53ea-4b58-9929-9b33f4996d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e974428dab64df7abb38e2a3e921add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:13Z,use_quota=True,user_id='c7d984947c024942b9032be45702f81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Creating volume 34241c20-53ea-4b58-9929-9b33f4996d31 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:30 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-34241c20-53ea-4b58-9929-9b33f4996d31 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:30 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Volume volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 (cb845a4d-b0fe-4964-95cf-acdb0fa62d83): created successfully Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c318152a-f457-4f9f-9cc6-eba652a15774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Flow 'volume_create_manager' (403b2693-2c88-4e56-b646-40d0031eafd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:30 devstack sudo[114143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-34241c20-53ea-4b58-9929-9b33f4996d31 1073741824 Jun 25 18:28:30 devstack sudo[114143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e91f6a-bef1-4cd1-965f-be761b355e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f1eaa9-7458-4ad8-bfbc-56c23073107e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:30 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e90dd1a8-26d4-46d7-8253-27027643a917 tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Created volume successfully. Jun 25 18:28:30 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a (ddea7d56-9e40-40a2-8f75-df0f25e5c59a): created successfully Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f1eaa9-7458-4ad8-bfbc-56c23073107e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:30 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Flow 'volume_create_manager' (c31a41d6-0b32-44ca-84d4-5aeceeabecae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:30 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-0fe13f14-5a42-440c-a449-74c9b0bfafcc tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Created volume successfully. Jun 25 18:28:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Acquiring lock "cinder-cb845a4d-b0fe-4964-95cf-acdb0fa62d83-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Lock "cinder-cb845a4d-b0fe-4964-95cf-acdb0fa62d83-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Acquiring lock "cinder-quobyte-cb845a4d-b0fe-4964-95cf-acdb0fa62d83" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:31 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Lock "cinder-quobyte-cb845a4d-b0fe-4964-95cf-acdb0fa62d83" acquired by "delete_volume" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:31 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aef2e7-2dbc-4e3a-97ea-34520b3a2b93]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:31 devstack sudo[114143]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-34241c20-53ea-4b58-9929-9b33f4996d31 1073741824" returned: 0 in 1.275s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-34241c20-53ea-4b58-9929-9b33f4996d31 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:31 devstack sudo[114150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-34241c20-53ea-4b58-9929-9b33f4996d31 Jun 25 18:28:31 devstack sudo[114150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:31 devstack sudo[114149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 Jun 25 18:28:31 devstack sudo[114149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:32 devstack sudo[114150]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:32 devstack sudo[114149]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-34241c20-53ea-4b58-9929-9b33f4996d31" returned: 0 in 0.868s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] <== create_volume: return (2220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.224s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.686s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "cinder-quobyte-e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3-c49556c8-0183-4a97-a4ea-1791381c6fc0" by "_create_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83" returned: 0 in 0.993s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc21eda-b800-4ac7-8d37-cf9da6e16112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34241c20-53ea-4b58-9929-9b33f4996d31', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e8c096-9c7a-4eab-b8d9-d0736f3ae94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-quobyte-e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3-c49556c8-0183-4a97-a4ea-1791381c6fc0" acquired by "_create_volume_from_snapshot" :: waited 0.097s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Creating volume c49556c8-0183-4a97-a4ea-1791381c6fc0 from snapshot e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 {{(pid=93651) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "cinder-quobyte-c49556c8-0183-4a97-a4ea-1791381c6fc0" by "_copy_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:32 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Volume volume-34241c20-53ea-4b58-9929-9b33f4996d31 (34241c20-53ea-4b58-9929-9b33f4996d31): created successfully Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e8c096-9c7a-4eab-b8d9-d0736f3ae94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Flow 'volume_create_manager' (c3718cb8-b229-4aa1-9b68-94ca0612366a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-quobyte-c49556c8-0183-4a97-a4ea-1791381c6fc0" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] snapshot: e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3, volume: c49556c8-0183-4a97-a4ea-1791381c6fc0, {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:32 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-be036f9e-f161-45e5-aaa4-860810013a6d tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Created volume successfully. Jun 25 18:28:32 devstack sudo[114185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 Jun 25 18:28:32 devstack sudo[114185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca1f54b-fe4b-4584-8315-ba0e77a15a84]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Flow 'volume_create_manager' (6f49610e-77e2-4f96-9eea-c6c10c2de0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6514ad0b-0012-4292-97a4-f72db2e532ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:32 devstack sudo[114192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 Jun 25 18:28:32 devstack sudo[114192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6514ad0b-0012-4292-97a4-f72db2e532ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1018602520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2dec7c-6aaf-460a-9121-6d9b8ff00994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180f212db8e04d31af38cf080b6cab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:33Z,use_quota=True,user_id='97b48070764e473e8decc360d1275470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279ef028-b19b-4e2f-aef9-50f293fe609f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279ef028-b19b-4e2f-aef9-50f293fe609f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac47855-63a9-4170-9da1-825f2c53e1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac47855-63a9-4170-9da1-825f2c53e1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad2dec7c-6aaf-460a-9121-6d9b8ff00994', 'volume_name': 'volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18b5614-46d9-41d4-96bb-930b38b85a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18b5614-46d9-41d4-96bb-930b38b85a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c59941-7d87-4fbd-b797-e5534e274646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:32 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume ad2dec7c-6aaf-460a-9121-6d9b8ff00994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994', 'volume_size': 1} Jun 25 18:28:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:33 devstack sudo[114185]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83" returned: 1 in 1.090s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "cinder-34241c20-53ea-4b58-9929-9b33f4996d31-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:33 devstack sudo[114201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83 Jun 25 18:28:33 devstack sudo[114201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-34241c20-53ea-4b58-9929-9b33f4996d31-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "cinder-quobyte-34241c20-53ea-4b58-9929-9b33f4996d31" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-quobyte-34241c20-53ea-4b58-9929-9b33f4996d31" acquired by "delete_volume" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[6309c584-aec5-415d-af4b-9f0d6f75ad38]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-34241c20-53ea-4b58-9929-9b33f4996d31 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:33 devstack sudo[114192]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3" returned: 0 in 1.130s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4937cb89-0947-4363-aca8-455af8a6dd40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] will copy from snapshot at /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Creating direct copy from snapshot {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[8675a15b-4353-4633-b169-e759612b8062]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:33 devstack sudo[114204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-34241c20-53ea-4b58-9929-9b33f4996d31 Jun 25 18:28:33 devstack sudo[114204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:33 devstack sudo[114205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 Jun 25 18:28:33 devstack sudo[114205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:34 devstack sudo[114201]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-cb845a4d-b0fe-4964-95cf-acdb0fa62d83" returned: 0 in 0.884s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:34 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Lock "cinder-quobyte-cb845a4d-b0fe-4964-95cf-acdb0fa62d83" released by "delete_volume" :: held 3.074s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:34 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Created reservations ['ea8b19ad-f1be-4cb8-996a-7d22abacdbfc', '68bfb980-b018-4e30-8c94-6ff12ddc243a', '16b18dae-99c9-4745-9a1e-c41cfff1080f', 'a01b40af-a768-4857-87f1-bf6ebdd8e7de'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:34 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:34 devstack sudo[114213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:34 devstack sudo[114213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:34 devstack sudo[114205]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40" returned: 0 in 1.081s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:34 devstack cinder-volume[93651]: DEBUG cinder.utils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Path /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0 not found in is_blk_device check {{(pid=93651) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:28:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:34 devstack sudo[114204]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-34241c20-53ea-4b58-9929-9b33f4996d31" returned: 0 in 1.234s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:34 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-34241c20-53ea-4b58-9929-9b33f4996d31 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:34 devstack sudo[114219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0 Jun 25 18:28:34 devstack sudo[114219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:34 devstack sudo[114220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-34241c20-53ea-4b58-9929-9b33f4996d31 Jun 25 18:28:34 devstack sudo[114220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:35 devstack sudo[114213]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.068s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:35 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:35 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Deleted volume successfully. Jun 25 18:28:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e48473e0-a65b-43fe-b1ad-2ff3bf4d6f1c tempest-VolumeAndVolumeTypeFromImageTest-1426488642 None] Lock "cinder-cb845a4d-b0fe-4964-95cf-acdb0fa62d83-delete_volume" released by "delete_volume" :: held 4.510s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:35 devstack sudo[114220]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-34241c20-53ea-4b58-9929-9b33f4996d31" returned: 0 in 0.877s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-quobyte-34241c20-53ea-4b58-9929-9b33f4996d31" released by "delete_volume" :: held 2.176s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:35 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Created reservations ['8327a518-20ff-4c5d-b8b7-a31fdfe5acdd', 'dac61bf4-cc08-4e5f-b6de-05f2be664dbf', 'ce2fa990-1ec2-4942-9a92-addca5e66777', '643fd2cd-4037-4099-b674-f557fa5a9cf8'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:35 devstack sudo[114232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:35 devstack sudo[114232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:36 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "cinder-ddea7d56-9e40-40a2-8f75-df0f25e5c59a-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-ddea7d56-9e40-40a2-8f75-df0f25e5c59a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "cinder-quobyte-ddea7d56-9e40-40a2-8f75-df0f25e5c59a" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:37 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-quobyte-ddea7d56-9e40-40a2-8f75-df0f25e5c59a" acquired by "delete_volume" :: waited 0.065s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:37 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[864ebfb0-153f-4a19-8dd4-708af3a6dbbe]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:37 devstack sudo[114237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a Jun 25 18:28:37 devstack sudo[114237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:38 devstack sudo[114232]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:38 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 2.319s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:38 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:38 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Deleted volume successfully. Jun 25 18:28:38 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-1a10332d-c2de-41fa-94ca-d0e83232ffe7 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-34241c20-53ea-4b58-9929-9b33f4996d31-delete_volume" released by "delete_volume" :: held 4.950s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:28:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:39 devstack sudo[114237]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a" returned: 0 in 2.147s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:39 devstack sudo[114245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:39 devstack sudo[114245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:39 devstack sudo[114247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a Jun 25 18:28:39 devstack sudo[114247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:41 devstack sudo[114247]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ddea7d56-9e40-40a2-8f75-df0f25e5c59a" returned: 0 in 1.952s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-quobyte-ddea7d56-9e40-40a2-8f75-df0f25e5c59a" released by "delete_volume" :: held 4.239s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Created reservations ['08467d7d-8501-4943-9207-b8bd1cab1078', '0c08a9ca-498a-4c93-800b-60c31e461a1a', 'b6bb325a-01e1-4d79-8e02-5af1e645d345', '87682ad6-be74-4b85-abe1-2f9f45f38c56'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:41 devstack sudo[114245]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 2.369s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 28 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:41 devstack sudo[114251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:41 devstack sudo[114251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:41 devstack sudo[114219]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0" returned: 0 in 7.169s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac55bc0f-21d5-401e-b9ef-57ba6b299ac7]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "cinder-2f0b5ac2-b955-4e5d-bd6c-2483718a1107-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-2f0b5ac2-b955-4e5d-bd6c-2483718a1107-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:42 devstack sudo[114253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 Jun 25 18:28:42 devstack sudo[114253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "cinder-quobyte-2f0b5ac2-b955-4e5d-bd6c-2483718a1107" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-quobyte-2f0b5ac2-b955-4e5d-bd6c-2483718a1107" acquired by "delete_volume" :: waited 0.027s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:42 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03d6fc8-af2d-4a74-8170-a3ce71792eda]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:42 devstack sudo[114255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107 Jun 25 18:28:42 devstack sudo[114255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:42 devstack sudo[114251]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.888s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:42 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:42 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Deleted volume successfully. Jun 25 18:28:42 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-19f56ea4-ec6e-4681-9463-9cc73bed29f5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-ddea7d56-9e40-40a2-8f75-df0f25e5c59a-delete_volume" released by "delete_volume" :: held 5.751s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:43 devstack sudo[114253]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40" returned: 0 in 1.161s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Image conversion details: src /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40, size 1024.00 MB, duration 7.17 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:28:43 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Converted 1024.00 MB image at 142.78 MB/s Jun 25 18:28:43 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0 is being set with open permissions: ugo+rw Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:43 devstack sudo[114264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0 Jun 25 18:28:43 devstack sudo[114264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:43 devstack sudo[114255]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107" returned: 0 in 0.965s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:43 devstack sudo[114266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107 Jun 25 18:28:43 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:43 devstack sudo[114264]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0" returned: 0 in 0.692s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-quobyte-c49556c8-0183-4a97-a4ea-1791381c6fc0" released by "_copy_volume_from_snapshot" :: held 11.422s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-quobyte-e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3-c49556c8-0183-4a97-a4ea-1791381c6fc0" released by "_create_volume_from_snapshot" :: held 11.502s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.603s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1018602520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2dec7c-6aaf-460a-9121-6d9b8ff00994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180f212db8e04d31af38cf080b6cab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:33Z,use_quota=True,user_id='97b48070764e473e8decc360d1275470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Creating volume ad2dec7c-6aaf-460a-9121-6d9b8ff00994 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:43 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:43 devstack sudo[114270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 1073741824 Jun 25 18:28:43 devstack sudo[114270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e220cba7-ccfa-4425-a7a1-cc2c5b40a8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49556c8-0183-4a97-a4ea-1791381c6fc0', 'volume_size': 1, 'snapshot_id': 'e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21f2e1f-4d18-43e3-a16a-eee7d29d61d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:43 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Volume volume-c49556c8-0183-4a97-a4ea-1791381c6fc0 (c49556c8-0183-4a97-a4ea-1791381c6fc0): created successfully Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21f2e1f-4d18-43e3-a16a-eee7d29d61d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Flow 'volume_create_manager' (5aca99d3-3b1b-4cc0-ab06-fc17360d862d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:43 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:43 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-4aa03d6e-c623-491d-932f-78bf7e6a26b7 tempest-VolumeDependencyTests-615744048 None] Created volume successfully. Jun 25 18:28:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2f0b5ac2-b955-4e5d-bd6c-2483718a1107" returned: 0 in 0.807s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-quobyte-2f0b5ac2-b955-4e5d-bd6c-2483718a1107" released by "delete_volume" :: held 1.856s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Created reservations ['b69c1cdc-1d8b-4ce1-9695-c9a7893c028b', 'a0cf5efd-0601-4861-8ed1-24ec21dcf100', '269d07ed-5f60-4d4b-b5dc-eb8ec47388bc', '77bf6544-8571-404d-b610-bed696dec116'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:44 devstack sudo[114272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:44 devstack sudo[114272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "cinder-da5957c8-1a61-49d0-ad44-d7da8bfeab10-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-da5957c8-1a61-49d0-ad44-d7da8bfeab10-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "cinder-quobyte-da5957c8-1a61-49d0-ad44-d7da8bfeab10" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-quobyte-da5957c8-1a61-49d0-ad44-d7da8bfeab10" acquired by "delete_volume" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1e7947-e403-45c0-9d75-0d7c80b18d0e]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:44 devstack sudo[114274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10 Jun 25 18:28:44 devstack sudo[114274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "cinder-e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "cinder-quobyte-4937cb89-0947-4363-aca8-455af8a6dd40" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-quobyte-4937cb89-0947-4363-aca8-455af8a6dd40" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "cinder-quobyte-e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-quobyte-e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Deleting offline snapshot e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 of volume 4937cb89-0947-4363-aca8-455af8a6dd40 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] snapshot_file for this snap is: volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd88612-601e-4076-ae32-caca0a6c5fb5]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:45 devstack sudo[114272]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.882s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:45 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:45 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Deleted volume successfully. Jun 25 18:28:45 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-7a228e24-a797-4f78-9baf-3aef40ed31e5 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-2f0b5ac2-b955-4e5d-bd6c-2483718a1107-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:45 devstack sudo[114270]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 1073741824" returned: 0 in 1.288s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:45 devstack sudo[114280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 Jun 25 18:28:45 devstack sudo[114280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:45 devstack sudo[114282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 Jun 25 18:28:45 devstack sudo[114282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:45 devstack sudo[114274]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10" returned: 0 in 1.066s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:45 devstack sudo[114288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10 Jun 25 18:28:45 devstack sudo[114288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:45 devstack sudo[114280]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3" returned: 0 in 0.978s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:45 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4937cb89-0947-4363-aca8-455af8a6dd40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa59ea65-e9d9-44cb-8af5-0d53f0629848]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:46 devstack sudo[114282]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994" returned: 0 in 0.870s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.261s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c59941-7d87-4fbd-b797-e5534e274646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:46 devstack sudo[114296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 Jun 25 18:28:46 devstack sudo[114296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3270d4d0-b3c2-47b5-9b6d-0cbc4ead60e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:46 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 (ad2dec7c-6aaf-460a-9121-6d9b8ff00994): created successfully Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3270d4d0-b3c2-47b5-9b6d-0cbc4ead60e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Flow 'volume_create_manager' (6f49610e-77e2-4f96-9eea-c6c10c2de0ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:46 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-44b83175-1db0-49e7-8d81-717df0128456 tempest-CreateVolumesFromSnapshotTest-71388379 None] Created volume successfully. Jun 25 18:28:46 devstack sudo[114288]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-da5957c8-1a61-49d0-ad44-d7da8bfeab10" returned: 0 in 0.903s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-quobyte-da5957c8-1a61-49d0-ad44-d7da8bfeab10" released by "delete_volume" :: held 2.032s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Created reservations ['19133fc6-bbad-4be7-a568-b46451864f60', 'e57520c7-d485-45d6-9dd2-86af9cd4f9dc', 'cea88700-e2c5-404d-816c-b1a182d16e39', '1129dc88-7d7b-4ae0-bd5c-5f6f03a9fe16'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] Creating offline snapshot d919bd6b-34c6-4a53-b61f-0128de675a20 of volume ad2dec7c-6aaf-460a-9121-6d9b8ff00994 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[45307e09-83cb-45a6-bdf2-c220d8f45b9f]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:46 devstack sudo[114302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:46 devstack sudo[114302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:46 devstack sudo[114299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 Jun 25 18:28:46 devstack sudo[114299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:47 devstack sudo[114296]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40" returned: 0 in 1.008s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:47 devstack sudo[114309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 Jun 25 18:28:47 devstack sudo[114309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Flow 'volume_create_manager' (975e9804-62cd-4426-82a8-45e511fd6bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a250dc9-1c50-4d79-ba9b-8e4542b86803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a250dc9-1c50-4d79-ba9b-8e4542b86803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a00517f-eebc-46c8-9289-99f3e6c47735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02933df7941a4322a3f671ea6295d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:47Z,use_quota=True,user_id='51dfe79ce3294d3c876783dc664a5353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717c3347-f81f-4106-b6b0-fa96ec5eb21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717c3347-f81f-4106-b6b0-fa96ec5eb21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ccb30c-9dd4-43a8-8990-94b21e6616a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.image.glance [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Creating Keystone auth plugin from conf {{(pid=93651) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 18:28:47 devstack sudo[114302]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.912s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:47 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Deleted volume successfully. Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e1fd9387-c023-46ca-90d1-8cba12201f31 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-da5957c8-1a61-49d0-ad44-d7da8bfeab10-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "cinder-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:47 devstack sudo[114299]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ccb30c-9dd4-43a8-8990-94b21e6616a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a00517f-eebc-46c8-9289-99f3e6c47735', 'volume_name': 'volume-1a00517f-eebc-46c8-9289-99f3e6c47735', 'volume_size': 1, 'image_id': '6011f840-3b4e-41b2-9869-819cbc8cb1a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6011f840-3b4e-41b2-9869-819cbc8cb1a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03e22e7deb1bf92fff5d5457a7b9fb9e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02933df7941a4322a3f671ea6295d3e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfe12e597c7be5462f250fa333d9dfef6786971140dc670ed0a0ff543d529186efeedfb17f278dbf09a82b83eaa62d7bf4ba926a14e95cd539035bea8d8204af', 'id': '6011f840-3b4e-41b2-9869-819cbc8cb1a0', 'created_at': datetime.datetime(2026, 6, 25, 16, 28, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 28, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6011f840-3b4e-41b2-9869-819cbc8cb1a0/file', 'properties': {}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8a1821-3e55-481f-bd34-4a95c319d60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8a1821-3e55-481f-bd34-4a95c319d60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d350680-1bed-4535-bc94-46f88e757a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:47 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Volume 1a00517f-eebc-46c8-9289-99f3e6c47735: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a00517f-eebc-46c8-9289-99f3e6c47735', 'volume_size': 1, 'image_id': '6011f840-3b4e-41b2-9869-819cbc8cb1a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6011f840-3b4e-41b2-9869-819cbc8cb1a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03e22e7deb1bf92fff5d5457a7b9fb9e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02933df7941a4322a3f671ea6295d3e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfe12e597c7be5462f250fa333d9dfef6786971140dc670ed0a0ff543d529186efeedfb17f278dbf09a82b83eaa62d7bf4ba926a14e95cd539035bea8d8204af', 'id': '6011f840-3b4e-41b2-9869-819cbc8cb1a0', 'created_at': datetime.datetime(2026, 6, 25, 16, 28, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 28, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6011f840-3b4e-41b2-9869-819cbc8cb1a0/file', 'properties': {}}, 'image_service': } Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Trying to clone 1a00517f-eebc-46c8-9289-99f3e6c47735 from image 6011f840-3b4e-41b2-9869-819cbc8cb1a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6011f840-3b4e-41b2-9869-819cbc8cb1a0', 'metadata': {}}]). {{(pid=93651) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994" returned: 0 in 1.140s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:47 devstack sudo[114320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 1G Jun 25 18:28:47 devstack sudo[114320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "cinder-quobyte-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-quobyte-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea" acquired by "delete_volume" :: waited 0.021s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8d4cad-0574-49d4-99b3-5e5a20808728]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:48 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 18:28:48 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Image download 0.00 MB at 0.00 MB/s Jun 25 18:28:48 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b514d2-265b-4cb2-a96d-f438baac8bc2]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:48 devstack sudo[114309]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3" returned: 0 in 1.117s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:48 devstack sudo[114323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea Jun 25 18:28:48 devstack sudo[114323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:48 devstack sudo[114325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3 Jun 25 18:28:48 devstack sudo[114325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:48 devstack sudo[114324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD Jun 25 18:28:48 devstack sudo[114324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:48 devstack sudo[114320]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 1G" returned: 0 in 0.997s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:48 devstack sudo[114338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 Jun 25 18:28:48 devstack sudo[114338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:48 devstack sudo[114325]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40.e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3" returned: 0 in 0.780s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:48 devstack sudo[114324]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD" returned: 0 in 0.885s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-quobyte-e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3" released by "_delete_snapshot" :: held 4.049s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-quobyte-4937cb89-0947-4363-aca8-455af8a6dd40" released by "delete_snapshot" :: held 4.088s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:49 devstack sudo[114323]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea" returned: 0 in 1.102s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:49 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Created reservations ['3f2522c7-bf88-4756-a41e-0cbe679c2115', '767ef2ad-9374-4d66-a345-10a1dfcfc01b', 'b54f21bf-a27a-4989-893d-18bf07600e01', '625d5702-4393-4f2c-b3d8-dbefb7fe4398'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:49 devstack sudo[114342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD Jun 25 18:28:49 devstack sudo[114342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:49 devstack sudo[114343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea Jun 25 18:28:49 devstack sudo[114343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:49 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Delete snapshot completed successfully. Jun 25 18:28:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-242086b2-ce10-4af4-9c32-3a84c54be358 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-e814f0cd-8c5d-4bb6-b76f-03bcb8db0dd3-delete_snapshot" released by "delete_snapshot" :: held 4.319s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:49 devstack sudo[114338]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20" returned: 0 in 0.818s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:49 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 is being set with open permissions: ugo+rw Jun 25 18:28:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:49 devstack sudo[114349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 Jun 25 18:28:49 devstack sudo[114349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:49 devstack sudo[114343]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea" returned: 0 in 0.792s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:49 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-quobyte-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea" released by "delete_volume" :: held 1.953s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:49 devstack sudo[114342]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD" returned: 1 in 0.923s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:28:49 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Temporary image 6011f840-3b4e-41b2-9869-819cbc8cb1a0 is fetched for user 51dfe79ce3294d3c876783dc664a5353. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 18:28:49 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Created reservations ['0f1abfc5-ccc2-4384-8713-0272e8cc61c6', '38ec49c5-fefd-40fa-b3b4-e5a234954d26', '28d67f8d-7866-4350-a0b1-8f5493569438', '1ba5647f-35a4-435a-b130-f4fbf32dd824'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[043b058f-12e8-40f7-9ccd-a114760ccb73]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:50 devstack sudo[114356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:50 devstack sudo[114356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:50 devstack sudo[114355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD Jun 25 18:28:50 devstack sudo[114355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "cinder-4937cb89-0947-4363-aca8-455af8a6dd40-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-4937cb89-0947-4363-aca8-455af8a6dd40-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "cinder-quobyte-4937cb89-0947-4363-aca8-455af8a6dd40" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:50 devstack sudo[114349]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-quobyte-4937cb89-0947-4363-aca8-455af8a6dd40" acquired by "delete_volume" :: waited 0.018s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20" returned: 0 in 0.764s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc521ad-9ae2-4fcc-9b3b-6ae74bcc8d7d]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:50 devstack sudo[114361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.info Jun 25 18:28:50 devstack sudo[114361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:50 devstack sudo[114360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 Jun 25 18:28:50 devstack sudo[114360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:50 devstack sudo[114355]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD" returned: 0 in 0.912s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:50 devstack sudo[114356]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.867s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:50 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:50 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Deleted volume successfully. Jun 25 18:28:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-e05cf7d1-bf8c-4144-91ce-fcdd9b75b317 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-2a56017e-360d-4f9c-8afe-bbe8df3fc6ea-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:51 devstack sudo[114368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD Jun 25 18:28:51 devstack sudo[114368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "cinder-5845a9ba-32ba-4322-b16a-7a27652699a6-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-5845a9ba-32ba-4322-b16a-7a27652699a6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "cinder-quobyte-5845a9ba-32ba-4322-b16a-7a27652699a6" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-quobyte-5845a9ba-32ba-4322-b16a-7a27652699a6" acquired by "delete_volume" :: waited 0.019s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:51 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d64c8c-4f6b-4a0f-bd1c-1262144e65ec]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5845a9ba-32ba-4322-b16a-7a27652699a6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:51 devstack sudo[114361]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.info" returned: 0 in 0.846s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:51 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.info is being set with open permissions: ugo+rw Jun 25 18:28:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:51 devstack sudo[114376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.info Jun 25 18:28:51 devstack sudo[114376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:51 devstack sudo[114360]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40" returned: 0 in 1.019s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:51 devstack sudo[114375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5845a9ba-32ba-4322-b16a-7a27652699a6 Jun 25 18:28:51 devstack sudo[114375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:51 devstack sudo[114379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40 Jun 25 18:28:51 devstack sudo[114379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:51 devstack sudo[114368]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD" returned: 1 in 1.009s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:28:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:52 devstack sudo[114376]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.info" returned: 0 in 0.805s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.555s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.277s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a00517f-eebc-46c8-9289-99f3e6c47735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02933df7941a4322a3f671ea6295d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:47Z,use_quota=True,user_id='51dfe79ce3294d3c876783dc664a5353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Creating volume 1a00517f-eebc-46c8-9289-99f3e6c47735 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:52 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:52 devstack sudo[114389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 1073741824 Jun 25 18:28:52 devstack sudo[114389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:52 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6c733e77-8d42-4115-863b-89b3a18a3a77 tempest-CreateVolumesFromSnapshotTest-71388379 None] Create snapshot completed successfully Jun 25 18:28:52 devstack sudo[114379]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-4937cb89-0947-4363-aca8-455af8a6dd40" returned: 0 in 0.826s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:52 devstack sudo[114375]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5845a9ba-32ba-4322-b16a-7a27652699a6" returned: 0 in 1.021s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5845a9ba-32ba-4322-b16a-7a27652699a6 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-quobyte-4937cb89-0947-4363-aca8-455af8a6dd40" released by "delete_volume" :: held 1.966s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:52 devstack sudo[114391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5845a9ba-32ba-4322-b16a-7a27652699a6 Jun 25 18:28:52 devstack sudo[114391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Created reservations ['7949cf53-205c-4d21-b089-bb0efcb9aef6', '344c3948-6660-4b0b-9b75-109ac3f91bf3', '01732b73-5882-4083-888e-705ad35dd3df', 'f595ef0e-2422-40c9-ba0f-95d01535a795'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:52 devstack sudo[114393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:52 devstack sudo[114393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "cinder-c49556c8-0183-4a97-a4ea-1791381c6fc0-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-c49556c8-0183-4a97-a4ea-1791381c6fc0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "cinder-quobyte-c49556c8-0183-4a97-a4ea-1791381c6fc0" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-quobyte-c49556c8-0183-4a97-a4ea-1791381c6fc0" acquired by "delete_volume" :: waited 0.040s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26f6cfa-1d11-45c1-958f-7c5cb5359d56]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:53 devstack sudo[114395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0 Jun 25 18:28:53 devstack sudo[114395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:53 devstack sudo[114391]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-5845a9ba-32ba-4322-b16a-7a27652699a6" returned: 0 in 0.911s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-quobyte-5845a9ba-32ba-4322-b16a-7a27652699a6" released by "delete_volume" :: held 1.996s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Created reservations ['582f18c5-2036-4ccc-83ec-ff3aaffb4371', 'e983a71f-45d6-48bd-bfa7-13b5919e11e7', '83ee81d3-6c26-4e8d-a577-a701b8190383', '18abaf00-ca3c-41d6-9878-51d8eba09e39'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=117,cinder:UPDATE=151,cinder:INSERT=39,cinder:DELETE=15 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:28:53 devstack sudo[114389]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 1073741824" returned: 0 in 1.370s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:53 devstack sudo[114404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:53 devstack sudo[114404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:53 devstack sudo[114405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 Jun 25 18:28:53 devstack sudo[114405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:53 devstack sudo[114393]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.184s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:53 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Deleted volume successfully. Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-83c8873f-d85e-4661-88af-8ffa7d248128 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-4937cb89-0947-4363-aca8-455af8a6dd40-delete_volume" released by "delete_volume" :: held 3.518s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Flow 'volume_create_manager' (0bfe0bb2-060c-46ac-b3f1-b41e2d57a77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96921f7e-5e56-4c7d-b4de-792f42535151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96921f7e-5e56-4c7d-b4de-792f42535151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-700989733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46355b2c-97fd-4042-aa31-604054317e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180f212db8e04d31af38cf080b6cab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:54Z,use_quota=True,user_id='97b48070764e473e8decc360d1275470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02376cd0-b6f6-466b-b139-ada98ffafc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02376cd0-b6f6-466b-b139-ada98ffafc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fcb40fc-8805-42d1-841d-514211cf764d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:53 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fcb40fc-8805-42d1-841d-514211cf764d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46355b2c-97fd-4042-aa31-604054317e39', 'volume_name': 'volume-46355b2c-97fd-4042-aa31-604054317e39', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45137975-4639-454e-ab22-1b4028463ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45137975-4639-454e-ab22-1b4028463ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85981cd6-6696-4eeb-87f8-8987aebbbd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:54 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume 46355b2c-97fd-4042-aa31-604054317e39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46355b2c-97fd-4042-aa31-604054317e39', 'volume_size': 1} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:54 devstack sudo[114395]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0" returned: 0 in 1.249s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:54 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0 Jun 25 18:28:54 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Flow 'volume_create_manager' (5e62a3f4-e7d3-46fa-a3eb-85165399b9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083c138b-7659-4459-9152-7b2e039980f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083c138b-7659-4459-9152-7b2e039980f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-309717904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ad6ecdb-9908-45fa-b27b-1c4dd550de54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180f212db8e04d31af38cf080b6cab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:54Z,use_quota=True,user_id='97b48070764e473e8decc360d1275470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413c3fae-77cd-4c0e-b596-021d9a5a87cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413c3fae-77cd-4c0e-b596-021d9a5a87cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87437b7-4fc6-4a35-b5d6-10d6dbe9b3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87437b7-4fc6-4a35-b5d6-10d6dbe9b3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ad6ecdb-9908-45fa-b27b-1c4dd550de54', 'volume_name': 'volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48214bb1-fa38-4941-a816-dbf59c3c277c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48214bb1-fa38-4941-a816-dbf59c3c277c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54579780-f78f-4cb0-84b3-67d175bc9011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:54 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume 0ad6ecdb-9908-45fa-b27b-1c4dd550de54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54', 'volume_size': 1} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:54 devstack sudo[114405]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735" returned: 0 in 1.164s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] <== create_volume: return (2619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.622s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.821s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-700989733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46355b2c-97fd-4042-aa31-604054317e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180f212db8e04d31af38cf080b6cab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:54Z,use_quota=True,user_id='97b48070764e473e8decc360d1275470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Creating volume 46355b2c-97fd-4042-aa31-604054317e39 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:54 devstack sudo[114404]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:54 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-46355b2c-97fd-4042-aa31-604054317e39 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.288s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:54 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:54 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Deleted volume successfully. Jun 25 18:28:54 devstack sudo[114417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-46355b2c-97fd-4042-aa31-604054317e39 1073741824 Jun 25 18:28:54 devstack sudo[114417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Attempting download of 6011f840-3b4e-41b2-9869-819cbc8cb1a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/6011f840-3b4e-41b2-9869-819cbc8cb1a0', 'metadata': {}}])) to volume 1a00517f-eebc-46c8-9289-99f3e6c47735. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-0f5098a0-710c-4344-8e37-d39bce0ba8a3 tempest-CreateVolumesFromSourceVolumeTest-488544941 None] Lock "cinder-5845a9ba-32ba-4322-b16a-7a27652699a6-delete_volume" released by "delete_volume" :: held 3.826s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Flow 'volume_create_manager' (e4b1b468-fec2-4b59-ab25-f5c9c6dd1355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622365af-144b-4ac3-b052-bc68dacd1e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622365af-144b-4ac3-b052-bc68dacd1e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-928101131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180f212db8e04d31af38cf080b6cab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:55Z,use_quota=True,user_id='97b48070764e473e8decc360d1275470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd6ad58-0563-4ae3-b382-3bfd67840811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd6ad58-0563-4ae3-b382-3bfd67840811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b23016f-7d07-47d9-805f-250fb7e70be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b23016f-7d07-47d9-805f-250fb7e70be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a', 'volume_name': 'volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0c286a-1268-4808-a828-43b3c83dea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0c286a-1268-4808-a828-43b3c83dea8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcfb50a-e4c9-440e-86e3-6de752590bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:55 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume 15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a', 'volume_size': 1} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd52e47-1eda-4f65-ad3e-fc25ef213759]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6011f840-3b4e-41b2-9869-819cbc8cb1a0_6ara_fzz {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:55 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-c49556c8-0183-4a97-a4ea-1791381c6fc0" returned: 0 in 1.174s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:55 devstack sudo[114420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6011f840-3b4e-41b2-9869-819cbc8cb1a0_6ara_fzz Jun 25 18:28:55 devstack sudo[114420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-quobyte-c49556c8-0183-4a97-a4ea-1791381c6fc0" released by "delete_volume" :: held 2.505s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Created reservations ['1571f70e-6ce7-4679-93a9-200ed24cda2f', 'df8f98d1-a4cd-41dd-8cff-896d984ec14b', '84b60d2b-957d-4ad1-8190-7ab5ae4713cc', '9b093219-46d6-45f1-b57a-fb79157bed56'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:55 devstack sudo[114422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:28:55 devstack sudo[114422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Flow 'volume_create_manager' (7b007e1f-87ab-48c1-890f-047aecdd437f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:55 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9af056c-ea54-4933-9ef8-3a3051f58a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9af056c-ea54-4933-9ef8-3a3051f58a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-631344490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980e3519-d624-48b2-8d87-7903b0016119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180f212db8e04d31af38cf080b6cab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:56Z,use_quota=True,user_id='97b48070764e473e8decc360d1275470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3554748f-8eb5-4edb-b20c-7af948f056e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3554748f-8eb5-4edb-b20c-7af948f056e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8aa135e-8761-452a-9e6f-904f703dac5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8aa135e-8761-452a-9e6f-904f703dac5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '980e3519-d624-48b2-8d87-7903b0016119', 'volume_name': 'volume-980e3519-d624-48b2-8d87-7903b0016119', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91fded61-ed9b-4ab9-b37d-d495c13025d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91fded61-ed9b-4ab9-b37d-d495c13025d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4622699a-3612-4456-8d57-145e9ac1ad4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:56 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume 980e3519-d624-48b2-8d87-7903b0016119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-980e3519-d624-48b2-8d87-7903b0016119', 'volume_size': 1} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:56 devstack sudo[114420]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6011f840-3b4e-41b2-9869-819cbc8cb1a0_6ara_fzz" returned: 0 in 1.183s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6011f840-3b4e-41b2-9869-819cbc8cb1a0_6ara_fzz {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:56 devstack sudo[114429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6011f840-3b4e-41b2-9869-819cbc8cb1a0_6ara_fzz Jun 25 18:28:56 devstack sudo[114429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:56 devstack sudo[114417]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-46355b2c-97fd-4042-aa31-604054317e39 1073741824" returned: 0 in 1.818s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-46355b2c-97fd-4042-aa31-604054317e39 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:56 devstack sudo[114432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-46355b2c-97fd-4042-aa31-604054317e39 Jun 25 18:28:56 devstack sudo[114432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:56 devstack sudo[114422]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.303s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:28:56 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Deleted volume successfully. Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-012eb417-ef63-44de-89e5-bc65a28e4761 tempest-VolumeDependencyTests-615744048 None] Lock "cinder-c49556c8-0183-4a97-a4ea-1791381c6fc0-delete_volume" released by "delete_volume" :: held 4.190s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Flow 'volume_create_manager' (c064381b-89a8-4b0c-bf09-f1f8d6dfe583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:56 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbef072-f39c-4556-bf04-e473a6035b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbef072-f39c-4556-bf04-e473a6035b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1646734012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93aa3f85-ac76-47a4-9e56-c6fc55e157bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180f212db8e04d31af38cf080b6cab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:57Z,use_quota=True,user_id='97b48070764e473e8decc360d1275470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e03793-3c1c-43df-b8af-1e3ff22650c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e03793-3c1c-43df-b8af-1e3ff22650c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644927b6-1720-41a6-9574-32dc934354b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644927b6-1720-41a6-9574-32dc934354b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93aa3f85-ac76-47a4-9e56-c6fc55e157bb', 'volume_name': 'volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81219698-4d51-46b3-94cc-01a4d5d01b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81219698-4d51-46b3-94cc-01a4d5d01b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f53196-f33e-4b92-9f9d-6710cc7c83ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:57 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume 93aa3f85-ac76-47a4-9e56-c6fc55e157bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb', 'volume_size': 1} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:57 devstack sudo[114429]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6011f840-3b4e-41b2-9869-819cbc8cb1a0_6ara_fzz" returned: 1 in 1.361s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6011f840-3b4e-41b2-9869-819cbc8cb1a0_6ara_fzz' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab1c06c-ec67-4ea8-b7b2-730ef93080b2]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:57 devstack sudo[114432]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-46355b2c-97fd-4042-aa31-604054317e39" returned: 0 in 1.002s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] <== create_volume: return (2904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.922s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.218s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-309717904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ad6ecdb-9908-45fa-b27b-1c4dd550de54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180f212db8e04d31af38cf080b6cab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:54Z,use_quota=True,user_id='97b48070764e473e8decc360d1275470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Creating volume 0ad6ecdb-9908-45fa-b27b-1c4dd550de54 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:28:57 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85981cd6-6696-4eeb-87f8-8987aebbbd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46355b2c-97fd-4042-aa31-604054317e39', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7ea251-916e-47fc-aa17-9aca2df682be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:28:57 devstack sudo[114438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54 1073741824 Jun 25 18:28:57 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:57 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume volume-46355b2c-97fd-4042-aa31-604054317e39 (46355b2c-97fd-4042-aa31-604054317e39): created successfully Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7ea251-916e-47fc-aa17-9aca2df682be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:28:57 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Flow 'volume_create_manager' (0bfe0bb2-060c-46ac-b3f1-b41e2d57a77f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:28:57 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2e50508f-6bb4-47f2-b1bc-1aff17cb3db3 tempest-CreateVolumesFromSnapshotTest-71388379 None] Created volume successfully. Jun 25 18:28:57 devstack sudo[114437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD Jun 25 18:28:57 devstack sudo[114437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:58 devstack sudo[114437]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD" returned: 0 in 1.071s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:58 devstack sudo[114448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD Jun 25 18:28:58 devstack sudo[114448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:58 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:58 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54 1073741824" returned: 0 in 1.171s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:59 devstack sudo[114450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54 Jun 25 18:28:59 devstack sudo[114450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:28:59 devstack sudo[114448]: pam_unix(sudo:session): session closed for user root Jun 25 18:28:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD" returned: 1 in 1.100s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:28:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:28:59 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] 6011f840-3b4e-41b2-9869-819cbc8cb1a0 was raw, converting to raw {{(pid=93651) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 18:28:59 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:28:59 devstack sudo[114456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 Jun 25 18:28:59 devstack sudo[114456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:00 devstack sudo[114450]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54" returned: 0 in 0.995s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.827s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-928101131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180f212db8e04d31af38cf080b6cab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:55Z,use_quota=True,user_id='97b48070764e473e8decc360d1275470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Creating volume 15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:29:00 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54579780-f78f-4cb0-84b3-67d175bc9011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:00 devstack sudo[114458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a 1073741824 Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cfe515-abf1-4a01-8a2a-c4be0f89ae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:00 devstack sudo[114458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:00 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54 (0ad6ecdb-9908-45fa-b27b-1c4dd550de54): created successfully Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cfe515-abf1-4a01-8a2a-c4be0f89ae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:00 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Flow 'volume_create_manager' (5e62a3f4-e7d3-46fa-a3eb-85165399b9c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:29:00 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6fbb6546-8b32-4c6e-b338-0a1c1dde273b tempest-CreateVolumesFromSnapshotTest-71388379 None] Created volume successfully. Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Flow 'volume_create_manager' (9a572659-dd16-48aa-a589-0f0eb9288ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08c53d5-b658-48c9-b31f-71f71287955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:01 devstack sudo[114456]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735" returned: 0 in 1.276s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6011f840-3b4e-41b2-9869-819cbc8cb1a0_3sgw65z4devstack@QuobyteHD, size 0.00 MB, duration 1.28 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:29:01 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Converted 0.00 MB image at 0.00 MB/s Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:01 devstack sudo[114467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 1G Jun 25 18:29:01 devstack sudo[114467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08c53d5-b658-48c9-b31f-71f71287955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ea39f0-4858-4539-b420-6b3b7055cdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0eca47359b04236af96eb360316aced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:29:01Z,use_quota=True,user_id='85ede2c8e3784f86a5e53c03be1fe8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a7cc79-7a18-4c1d-880c-40f34ffc1bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a7cc79-7a18-4c1d-880c-40f34ffc1bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b85094-106f-4541-b664-16b9f42b61b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b85094-106f-4541-b664-16b9f42b61b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40ea39f0-4858-4539-b420-6b3b7055cdb1', 'volume_name': 'volume-40ea39f0-4858-4539-b420-6b3b7055cdb1', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fa8ef2-8af1-4ccf-9a29-923852ff4d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fa8ef2-8af1-4ccf-9a29-923852ff4d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4feac1f1-dbaa-4a74-983b-95f5c2f5857d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:01 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Volume 40ea39f0-4858-4539-b420-6b3b7055cdb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40ea39f0-4858-4539-b420-6b3b7055cdb1', 'volume_size': 1} Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:01 devstack sudo[114458]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a 1073741824" returned: 0 in 1.326s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:01 devstack sudo[114469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a Jun 25 18:29:01 devstack sudo[114469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:01 devstack sudo[114467]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:01 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 1G" returned: 0 in 0.764s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3b4ee7-4244-4de9-ba70-1d42a46697f1]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:02 devstack sudo[114474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 Jun 25 18:29:02 devstack sudo[114474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:02 devstack sudo[114469]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a" returned: 0 in 0.769s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] <== create_volume: return (2153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.036s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-631344490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980e3519-d624-48b2-8d87-7903b0016119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180f212db8e04d31af38cf080b6cab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:56Z,use_quota=True,user_id='97b48070764e473e8decc360d1275470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Creating volume 980e3519-d624-48b2-8d87-7903b0016119 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:29:02 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-980e3519-d624-48b2-8d87-7903b0016119 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcfb50a-e4c9-440e-86e3-6de752590bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1163f368-0d4c-4101-87fa-4088a2d19751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:02 devstack sudo[114477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-980e3519-d624-48b2-8d87-7903b0016119 1073741824 Jun 25 18:29:02 devstack sudo[114477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:02 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a (15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a): created successfully Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1163f368-0d4c-4101-87fa-4088a2d19751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Flow 'volume_create_manager' (e4b1b468-fec2-4b59-ab25-f5c9c6dd1355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:29:02 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-2be52c94-2ab0-4c24-8349-ec18b96236ba tempest-CreateVolumesFromSnapshotTest-71388379 None] Created volume successfully. Jun 25 18:29:02 devstack sudo[114474]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735" returned: 0 in 0.900s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:02 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:03 devstack sudo[114484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 Jun 25 18:29:03 devstack sudo[114484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:03 devstack sudo[114477]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-980e3519-d624-48b2-8d87-7903b0016119 1073741824" returned: 0 in 1.187s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:03 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=191,cinder:SELECT=129,cinder:DELETE=15,cinder:INSERT=45 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:29:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-980e3519-d624-48b2-8d87-7903b0016119 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:03 devstack sudo[114487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-980e3519-d624-48b2-8d87-7903b0016119 Jun 25 18:29:03 devstack sudo[114487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:03 devstack sudo[114484]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735" returned: 1 in 0.876s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:03 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:29:03 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Downloaded image 6011f840-3b4e-41b2-9869-819cbc8cb1a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/6011f840-3b4e-41b2-9869-819cbc8cb1a0', 'metadata': {}}])) to volume 1a00517f-eebc-46c8-9289-99f3e6c47735 successfully. {{(pid=93651) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 18:29:03 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Temporary image 6011f840-3b4e-41b2-9869-819cbc8cb1a0 for user 51dfe79ce3294d3c876783dc664a5353 is deleted. {{(pid=93651) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 18:29:03 devstack cinder-volume[93651]: DEBUG cinder.volume.volume_utils [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Marking volume 1a00517f-eebc-46c8-9289-99f3e6c47735 as bootable. {{(pid=93651) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 18:29:03 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Copying metadata from image 6011f840-3b4e-41b2-9869-819cbc8cb1a0 to 1a00517f-eebc-46c8-9289-99f3e6c47735. {{(pid=93651) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 18:29:03 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Creating volume glance metadata for volume 1a00517f-eebc-46c8-9289-99f3e6c47735 backed by image 6011f840-3b4e-41b2-9869-819cbc8cb1a0 with: {'image_id': '6011f840-3b4e-41b2-9869-819cbc8cb1a0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '03e22e7deb1bf92fff5d5457a7b9fb9e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93651) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 18:29:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d350680-1bed-4535-bc94-46f88e757a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a00517f-eebc-46c8-9289-99f3e6c47735', 'volume_size': 1, 'image_id': '6011f840-3b4e-41b2-9869-819cbc8cb1a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6011f840-3b4e-41b2-9869-819cbc8cb1a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03e22e7deb1bf92fff5d5457a7b9fb9e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02933df7941a4322a3f671ea6295d3e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfe12e597c7be5462f250fa333d9dfef6786971140dc670ed0a0ff543d529186efeedfb17f278dbf09a82b83eaa62d7bf4ba926a14e95cd539035bea8d8204af', 'id': '6011f840-3b4e-41b2-9869-819cbc8cb1a0', 'created_at': datetime.datetime(2026, 6, 25, 16, 28, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 16, 28, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6011f840-3b4e-41b2-9869-819cbc8cb1a0/file', 'properties': {}}, 'image_service': }' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d430195-ecfa-4855-ab8b-e657940ac6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:03 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Volume volume-1a00517f-eebc-46c8-9289-99f3e6c47735 (1a00517f-eebc-46c8-9289-99f3e6c47735): created successfully Jun 25 18:29:03 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d430195-ecfa-4855-ab8b-e657940ac6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Flow 'volume_create_manager' (975e9804-62cd-4426-82a8-45e511fd6bf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:29:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-38c74c76-6e0f-46c1-ab90-32bf66352e2a tempest-VolumeImageDependencyTests-1823913436 None] Created volume successfully. Jun 25 18:29:04 devstack sudo[114487]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-980e3519-d624-48b2-8d87-7903b0016119" returned: 0 in 0.820s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] <== create_volume: return (2090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.181s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1646734012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93aa3f85-ac76-47a4-9e56-c6fc55e157bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180f212db8e04d31af38cf080b6cab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:28:57Z,use_quota=True,user_id='97b48070764e473e8decc360d1275470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Creating volume 93aa3f85-ac76-47a4-9e56-c6fc55e157bb {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:29:04 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:04 devstack sudo[114493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb 1073741824 Jun 25 18:29:04 devstack sudo[114493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4622699a-3612-4456-8d57-145e9ac1ad4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-980e3519-d624-48b2-8d87-7903b0016119', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c249b0-51a0-40ff-ab57-bdc6762b6e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:04 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume volume-980e3519-d624-48b2-8d87-7903b0016119 (980e3519-d624-48b2-8d87-7903b0016119): created successfully Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c249b0-51a0-40ff-ab57-bdc6762b6e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:04 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Flow 'volume_create_manager' (7b007e1f-87ab-48c1-890f-047aecdd437f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:29:04 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-7accaacb-6076-4cd8-bf32-a8fe40a33c00 tempest-CreateVolumesFromSnapshotTest-71388379 None] Created volume successfully. Jun 25 18:29:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Acquiring lock "cinder-1a00517f-eebc-46c8-9289-99f3e6c47735-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Lock "cinder-1a00517f-eebc-46c8-9289-99f3e6c47735-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Acquiring lock "cinder-quobyte-1a00517f-eebc-46c8-9289-99f3e6c47735" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:05 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Lock "cinder-quobyte-1a00517f-eebc-46c8-9289-99f3e6c47735" acquired by "delete_volume" :: waited 0.019s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:05 devstack sudo[114493]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb 1073741824" returned: 0 in 1.204s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:05 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[9257bd0a-7731-487d-80df-688cca213153]: (4, 'raw') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:05 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:05 devstack sudo[114499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb Jun 25 18:29:05 devstack sudo[114499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:05 devstack sudo[114500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 Jun 25 18:29:05 devstack sudo[114500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:06 devstack sudo[114499]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb" returned: 0 in 0.785s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.044s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ea39f0-4858-4539-b420-6b3b7055cdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0eca47359b04236af96eb360316aced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:29:01Z,use_quota=True,user_id='85ede2c8e3784f86a5e53c03be1fe8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Creating volume 40ea39f0-4858-4539-b420-6b3b7055cdb1 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:29:06 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-40ea39f0-4858-4539-b420-6b3b7055cdb1 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:06 devstack sudo[114506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-40ea39f0-4858-4539-b420-6b3b7055cdb1 1073741824 Jun 25 18:29:06 devstack sudo[114506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f53196-f33e-4b92-9f9d-6710cc7c83ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6daade-8e49-4e49-a958-7879a41a0d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:06 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Volume volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb (93aa3f85-ac76-47a4-9e56-c6fc55e157bb): created successfully Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6daade-8e49-4e49-a958-7879a41a0d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Flow 'volume_create_manager' (c064381b-89a8-4b0c-bf09-f1f8d6dfe583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:29:06 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ab00aadc-6290-4575-be51-c174d868b324 tempest-CreateVolumesFromSnapshotTest-71388379 None] Created volume successfully. Jun 25 18:29:06 devstack sudo[114500]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735" returned: 0 in 0.950s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:06 devstack sudo[114508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 Jun 25 18:29:06 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-93aa3f85-ac76-47a4-9e56-c6fc55e157bb-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:06 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-93aa3f85-ac76-47a4-9e56-c6fc55e157bb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-quobyte-93aa3f85-ac76-47a4-9e56-c6fc55e157bb" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:07 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-93aa3f85-ac76-47a4-9e56-c6fc55e157bb" acquired by "delete_volume" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:07 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e388de3-9fd2-41a1-afcd-5aaedfe8267d]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:07 devstack sudo[114510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb Jun 25 18:29:07 devstack sudo[114510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:07 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735" returned: 1 in 1.247s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735' failed. Not Retrying. {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 18:29:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:07 devstack sudo[114506]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-40ea39f0-4858-4539-b420-6b3b7055cdb1 1073741824" returned: 0 in 1.419s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:07 devstack sudo[114518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735 Jun 25 18:29:07 devstack sudo[114518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:07 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-40ea39f0-4858-4539-b420-6b3b7055cdb1 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:07 devstack sudo[114520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-40ea39f0-4858-4539-b420-6b3b7055cdb1 Jun 25 18:29:07 devstack sudo[114520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:08 devstack sudo[114510]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb" returned: 0 in 1.232s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:08 devstack sudo[114526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb Jun 25 18:29:08 devstack sudo[114526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:08 devstack sudo[114518]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:08 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-1a00517f-eebc-46c8-9289-99f3e6c47735" returned: 0 in 0.980s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:08 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Lock "cinder-quobyte-1a00517f-eebc-46c8-9289-99f3e6c47735" released by "delete_volume" :: held 3.295s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:08 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Created reservations ['c166e85d-81ee-40f4-888e-1f797519813a', '9ad1bc11-0233-4ade-9b88-06290ac98552', 'ba9baa2d-ac42-4384-a698-5e681fb84504', '9cd525c4-d631-406c-95bc-80d3b6444798'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:09 devstack sudo[114520]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-40ea39f0-4858-4539-b420-6b3b7055cdb1" returned: 0 in 1.214s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] <== create_volume: return (2731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.739s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:09 devstack sudo[114531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:29:09 devstack sudo[114531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4feac1f1-dbaa-4a74-983b-95f5c2f5857d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40ea39f0-4858-4539-b420-6b3b7055cdb1', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8bd517-9995-4066-a820-e0b3cba5d18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:09 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Volume volume-40ea39f0-4858-4539-b420-6b3b7055cdb1 (40ea39f0-4858-4539-b420-6b3b7055cdb1): created successfully Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8bd517-9995-4066-a820-e0b3cba5d18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Flow 'volume_create_manager' (9a572659-dd16-48aa-a589-0f0eb9288ba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:29:09 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-0cf0eae1-cedb-4f3b-a466-2d50a818a4e4 tempest-CinderUnicodeTest-521598722 None] Created volume successfully. Jun 25 18:29:09 devstack sudo[114526]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-93aa3f85-ac76-47a4-9e56-c6fc55e157bb" returned: 0 in 0.905s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-93aa3f85-ac76-47a4-9e56-c6fc55e157bb" released by "delete_volume" :: held 2.242s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Created reservations ['c45df086-9d7f-435a-8041-f6bb28a84ad9', '0563ce7e-62e0-49c7-b66d-a046c891f815', 'c7fc5b74-6126-4871-b3ca-af5ae9248bf1', '8ad4ec19-29c1-4640-a305-6b7b3d8ad526'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:09 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:09 devstack sudo[114534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:29:09 devstack sudo[114534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:10 devstack sudo[114531]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.055s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:10 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:29:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Deleted volume successfully. Jun 25 18:29:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-01989fa0-1e7f-4d11-849f-90386c516584 tempest-VolumeImageDependencyTests-1823913436 None] Lock "cinder-1a00517f-eebc-46c8-9289-99f3e6c47735-delete_volume" released by "delete_volume" :: held 4.773s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-980e3519-d624-48b2-8d87-7903b0016119-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-980e3519-d624-48b2-8d87-7903b0016119-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:10 devstack sudo[114534]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.251s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:10 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:29:10 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Deleted volume successfully. Jun 25 18:29:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-quobyte-980e3519-d624-48b2-8d87-7903b0016119" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-980e3519-d624-48b2-8d87-7903b0016119" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:10 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-6d588441-4dc7-4d32-aeef-dfa04e7e7214 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-93aa3f85-ac76-47a4-9e56-c6fc55e157bb-delete_volume" released by "delete_volume" :: held 3.896s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:10 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[641d96a9-922d-4d57-9c4a-2e8e7a52f04f]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:10 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-980e3519-d624-48b2-8d87-7903b0016119 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:29:11 devstack sudo[114538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-980e3519-d624-48b2-8d87-7903b0016119 Jun 25 18:29:11 devstack sudo[114538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Flow 'volume_create_manager' (258ae169-02c2-4d4a-bb2c-20540417854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37e3d78-e5a0-4456-9232-de3b9c222745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37e3d78-e5a0-4456-9232-de3b9c222745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:29:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-113804892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d71ff5-6614-497a-934e-e3b4289a65b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0eca47359b04236af96eb360316aced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:29:11Z,use_quota=True,user_id='85ede2c8e3784f86a5e53c03be1fe8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad55c7c7-1a6d-4698-8303-4aff70e11547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad55c7c7-1a6d-4698-8303-4aff70e11547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f01e215f-d7c4-420f-b918-84277966dd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f01e215f-d7c4-420f-b918-84277966dd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d71ff5-6614-497a-934e-e3b4289a65b0', 'volume_name': 'volume-84d71ff5-6614-497a-934e-e3b4289a65b0', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc461be4-5e4c-4988-a9da-8207705a9e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc461be4-5e4c-4988-a9da-8207705a9e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8860c1f-2ebf-43f2-b705-f5cdce8d485f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:11 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Volume 84d71ff5-6614-497a-934e-e3b4289a65b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d71ff5-6614-497a-934e-e3b4289a65b0', 'volume_size': 1} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:29:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-113804892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d71ff5-6614-497a-934e-e3b4289a65b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0eca47359b04236af96eb360316aced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:29:11Z,use_quota=True,user_id='85ede2c8e3784f86a5e53c03be1fe8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Creating volume 84d71ff5-6614-497a-934e-e3b4289a65b0 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:29:11 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:11 devstack sudo[114540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0 1073741824 Jun 25 18:29:11 devstack sudo[114540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:11 devstack sudo[114538]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-980e3519-d624-48b2-8d87-7903b0016119" returned: 0 in 1.005s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:11 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-980e3519-d624-48b2-8d87-7903b0016119 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:11 devstack sudo[114545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-980e3519-d624-48b2-8d87-7903b0016119 Jun 25 18:29:11 devstack sudo[114545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:12 devstack sudo[114540]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0 1073741824" returned: 0 in 1.208s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:12 devstack sudo[114551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0 Jun 25 18:29:12 devstack sudo[114551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:12 devstack sudo[114545]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:12 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-980e3519-d624-48b2-8d87-7903b0016119" returned: 0 in 0.925s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:12 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-980e3519-d624-48b2-8d87-7903b0016119" released by "delete_volume" :: held 2.008s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:12 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Created reservations ['c8f91c1e-219a-494b-9119-a60082fa0aec', '5424f0be-82fb-4a47-8fa2-df7b3bd9c830', '97ee3367-f62b-41bf-991e-1a94d16e893f', '1945efb1-4849-4ab8-981e-85f9de585d37'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:13 devstack sudo[114554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:29:13 devstack sudo[114554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-quobyte-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a" acquired by "delete_volume" :: waited 0.019s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b555f66-50b5-497f-ab24-48368f322fde]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:13 devstack sudo[114556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a Jun 25 18:29:13 devstack sudo[114556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:13 devstack sudo[114551]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0" returned: 0 in 1.281s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] <== create_volume: return (2555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.563s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8860c1f-2ebf-43f2-b705-f5cdce8d485f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d71ff5-6614-497a-934e-e3b4289a65b0', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97cdb8d-fb46-4fcd-be1f-17bf9d7bb6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:13 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Volume volume-84d71ff5-6614-497a-934e-e3b4289a65b0 (84d71ff5-6614-497a-934e-e3b4289a65b0): created successfully Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97cdb8d-fb46-4fcd-be1f-17bf9d7bb6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:13 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Flow 'volume_create_manager' (258ae169-02c2-4d4a-bb2c-20540417854a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:29:13 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-f284f240-b92a-4d3e-a821-6f78420d80a0 tempest-CinderUnicodeTest-521598722 None] Created volume successfully. Jun 25 18:29:14 devstack sudo[114554]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.930s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:14 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:29:14 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Deleted volume successfully. Jun 25 18:29:14 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-c77eaaf5-5f4a-439d-850f-bad7bca63eca tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-980e3519-d624-48b2-8d87-7903b0016119-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:14 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] Creating offline snapshot 2e84634d-fb04-4e06-a33c-1c08a028d716 of volume 84d71ff5-6614-497a-934e-e3b4289a65b0 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:29:14 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[17793afe-c70b-40a3-9231-bdd3b314d8ee]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:14 devstack sudo[114556]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a" returned: 0 in 1.141s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:14 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:14 devstack sudo[114564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a Jun 25 18:29:14 devstack sudo[114564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:14 devstack sudo[114563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0 Jun 25 18:29:14 devstack sudo[114563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:15 devstack sudo[114564]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a" returned: 0 in 0.743s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a" released by "delete_volume" :: held 1.946s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Created reservations ['f482ec19-ccb3-42c3-a442-103be59bf15a', '655447ad-051f-4445-b12b-2622a06e91cf', '22458566-f0fb-409b-8907-3b10fda8fc07', 'a012eb40-69b1-42e9-be1d-0602894c1906'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:29:15 devstack sudo[114563]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0" returned: 0 in 0.911s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:15 devstack sudo[114571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 1G Jun 25 18:29:15 devstack sudo[114571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:15 devstack sudo[114573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:29:15 devstack sudo[114573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-0ad6ecdb-9908-45fa-b27b-1c4dd550de54-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-0ad6ecdb-9908-45fa-b27b-1c4dd550de54-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-quobyte-0ad6ecdb-9908-45fa-b27b-1c4dd550de54" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-0ad6ecdb-9908-45fa-b27b-1c4dd550de54" acquired by "delete_volume" :: waited 0.029s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73b204f-9454-4331-b81d-23cd16bf9126]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:15 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:15 devstack sudo[114575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54 Jun 25 18:29:15 devstack sudo[114575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:16 devstack sudo[114573]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.905s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:16 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:29:16 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Deleted volume successfully. Jun 25 18:29:16 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-01acf800-dc90-4a31-9182-16966d80be76 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-15ab33cc-1ba9-493f-9f85-fdc76d3f0c6a-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:16 devstack sudo[114571]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 1G" returned: 0 in 1.082s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d71ff5-6614-497a-934e-e3b4289a65b0 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:16 devstack sudo[114582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d71ff5-6614-497a-934e-e3b4289a65b0 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 Jun 25 18:29:16 devstack sudo[114582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:16 devstack sudo[114575]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54" returned: 0 in 0.995s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:16 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:16 devstack sudo[114588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54 Jun 25 18:29:16 devstack sudo[114588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:17 devstack sudo[114582]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d71ff5-6614-497a-934e-e3b4289a65b0 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716" returned: 0 in 0.840s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:17 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 is being set with open permissions: ugo+rw Jun 25 18:29:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:17 devstack sudo[114593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 Jun 25 18:29:17 devstack sudo[114593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:17 devstack sudo[114588]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-0ad6ecdb-9908-45fa-b27b-1c4dd550de54" returned: 0 in 0.747s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-0ad6ecdb-9908-45fa-b27b-1c4dd550de54" released by "delete_volume" :: held 1.804s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:17 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Created reservations ['3e61a434-e6ea-469f-891f-b8bc53db1735', '562dc841-fd65-4f50-9637-992eb53ca58b', '418a8f94-8743-488f-88a9-1f98d8ef16a1', '2bb4d1cd-ca4d-4aeb-bf04-a5a4418afa57'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:29:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:17 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:17 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:17 devstack sudo[114596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:29:17 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-46355b2c-97fd-4042-aa31-604054317e39-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:17 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-46355b2c-97fd-4042-aa31-604054317e39-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-quobyte-46355b2c-97fd-4042-aa31-604054317e39" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-46355b2c-97fd-4042-aa31-604054317e39" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:18 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ddc35e-3989-4f4e-afb2-b90cf7033870]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-46355b2c-97fd-4042-aa31-604054317e39 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:18 devstack sudo[114593]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716" returned: 0 in 0.786s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:18 devstack sudo[114600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.info Jun 25 18:29:18 devstack sudo[114600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:18 devstack sudo[114599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-46355b2c-97fd-4042-aa31-604054317e39 Jun 25 18:29:18 devstack sudo[114599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:18 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:18 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.924s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:18 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:29:18 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Deleted volume successfully. Jun 25 18:29:18 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-808001c2-2af1-4765-a13d-ec1dee6fcc6c tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-0ad6ecdb-9908-45fa-b27b-1c4dd550de54-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:19 devstack sudo[114600]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.info" returned: 0 in 1.027s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:19 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.info is being set with open permissions: ugo+rw Jun 25 18:29:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:19 devstack sudo[114599]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-46355b2c-97fd-4042-aa31-604054317e39" returned: 0 in 1.113s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-46355b2c-97fd-4042-aa31-604054317e39 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:19 devstack sudo[114609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.info Jun 25 18:29:19 devstack sudo[114609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:19 devstack sudo[114610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-46355b2c-97fd-4042-aa31-604054317e39 Jun 25 18:29:19 devstack sudo[114610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:19 devstack sudo[114609]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.info" returned: 0 in 0.794s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:19 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.568s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:20 devstack sudo[114610]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-46355b2c-97fd-4042-aa31-604054317e39" returned: 0 in 0.839s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:20 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-71a31786-76e0-48e3-a5d4-5f3e8610a27b tempest-CinderUnicodeTest-521598722 None] Create snapshot completed successfully Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-46355b2c-97fd-4042-aa31-604054317e39" released by "delete_volume" :: held 2.037s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Created reservations ['950fb9a9-d923-43c6-8a9d-090871fe05dd', '35bd5a10-811c-453c-9cfc-3d4252a574ee', '8ab073b7-2ead-4d3c-b339-81649da47715', '396459db-34a8-46f2-bfb7-8ebc08a0a64f'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:20 devstack sudo[114615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:29:20 devstack sudo[114615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-d919bd6b-34c6-4a53-b61f-0128de675a20-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-d919bd6b-34c6-4a53-b61f-0128de675a20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-quobyte-ad2dec7c-6aaf-460a-9121-6d9b8ff00994" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-ad2dec7c-6aaf-460a-9121-6d9b8ff00994" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-quobyte-d919bd6b-34c6-4a53-b61f-0128de675a20" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-d919bd6b-34c6-4a53-b61f-0128de675a20" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Deleting offline snapshot d919bd6b-34c6-4a53-b61f-0128de675a20 of volume ad2dec7c-6aaf-460a-9121-6d9b8ff00994 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] snapshot_file for this snap is: volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0844784-ac41-475f-b5b2-72a2978f804c]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:20 devstack sudo[114617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 Jun 25 18:29:20 devstack sudo[114617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Acquiring lock "cinder-2e84634d-fb04-4e06-a33c-1c08a028d716-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Lock "cinder-2e84634d-fb04-4e06-a33c-1c08a028d716-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Acquiring lock "cinder-quobyte-84d71ff5-6614-497a-934e-e3b4289a65b0" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Lock "cinder-quobyte-84d71ff5-6614-497a-934e-e3b4289a65b0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Acquiring lock "cinder-quobyte-2e84634d-fb04-4e06-a33c-1c08a028d716" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Lock "cinder-quobyte-2e84634d-fb04-4e06-a33c-1c08a028d716" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Deleting offline snapshot 2e84634d-fb04-4e06-a33c-1c08a028d716 of volume 84d71ff5-6614-497a-934e-e3b4289a65b0 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:29:20 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] snapshot_file for this snap is: volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:29:21 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ec24ee-0ec5-437f-8125-732e84d2ee8b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:21 devstack sudo[114619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 Jun 25 18:29:21 devstack sudo[114619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:21 devstack sudo[114615]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.228s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:21 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:29:21 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Deleted volume successfully. Jun 25 18:29:21 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ef359468-b06f-4cf8-9ee8-5b67f030fef8 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-46355b2c-97fd-4042-aa31-604054317e39-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:21 devstack sudo[114617]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20" returned: 0 in 1.186s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:21 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:29:21 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d113e3e-42ff-4aa8-90d8-e5347072d537]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:21 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:21 devstack sudo[114625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 Jun 25 18:29:21 devstack sudo[114625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:22 devstack sudo[114619]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716" returned: 0 in 1.039s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:22 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84d71ff5-6614-497a-934e-e3b4289a65b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:29:22 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[49009224-a425-4fe3-9407-457eeac8ad01]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:22 devstack sudo[114630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0 Jun 25 18:29:22 devstack sudo[114630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:22 devstack sudo[114625]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994" returned: 0 in 1.037s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:22 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:22 devstack sudo[114636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 Jun 25 18:29:22 devstack sudo[114636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:23 devstack sudo[114630]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0" returned: 0 in 1.002s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:23 devstack sudo[114641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 Jun 25 18:29:23 devstack sudo[114641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:23 devstack sudo[114636]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20" returned: 0 in 1.005s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:23 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:23 devstack sudo[114646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20 Jun 25 18:29:23 devstack sudo[114646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:24 devstack sudo[114641]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716" returned: 0 in 0.959s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:24 devstack sudo[114651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716 Jun 25 18:29:24 devstack sudo[114651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:29:24 devstack sudo[114646]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Flow 'volume_create_manager' (e9176a2f-5b93-44da-864a-45f0d086b8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50e634e-284e-4892-b2f9-f29a67b33404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994.d919bd6b-34c6-4a53-b61f-0128de675a20" returned: 0 in 0.807s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50e634e-284e-4892-b2f9-f29a67b33404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1608830457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e002cd34e054509b74816658e9d5851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:29:24Z,use_quota=True,user_id='baa5149fcc574e02ac1a30d194cd2208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859aa06b-1cea-401c-8711-694fda9a6ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859aa06b-1cea-401c-8711-694fda9a6ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5cd29c-0841-43db-9c9a-418bae07ce96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5cd29c-0841-43db-9c9a-418bae07ce96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123', 'volume_name': 'volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a977b6-ac77-4936-8c9f-3e3488cc436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a977b6-ac77-4936-8c9f-3e3488cc436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fad7270-93b5-467a-b5a7-f3767b6197fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:24 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Volume 624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123', 'volume_size': 1} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1608830457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e002cd34e054509b74816658e9d5851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:29:24Z,use_quota=True,user_id='baa5149fcc574e02ac1a30d194cd2208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)}" {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Creating volume 624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 {{(pid=93651) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:29:24 devstack cinder-volume[93651]: INFO cinder.volume.drivers.remotefs [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] casted to osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 1073741824 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:24 devstack sudo[114654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 1073741824 Jun 25 18:29:24 devstack sudo[114654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-d919bd6b-34c6-4a53-b61f-0128de675a20" released by "_delete_snapshot" :: held 4.269s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-ad2dec7c-6aaf-460a-9121-6d9b8ff00994" released by "delete_snapshot" :: held 4.298s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Created reservations ['57ea3202-a08a-4ee9-b829-0f8fdec5ee98', 'ed4ef821-b172-4051-8722-239340dc9a18', '150968b5-50e2-4904-92ed-21d727d5d52a', 'c704583f-198d-4623-b407-f125748e4b97'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:29:24 devstack sudo[114651]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0.2e84634d-fb04-4e06-a33c-1c08a028d716" returned: 0 in 0.703s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:24 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Delete snapshot completed successfully. Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Lock "cinder-quobyte-2e84634d-fb04-4e06-a33c-1c08a028d716" released by "_delete_snapshot" :: held 3.876s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-5decc245-0ab9-4835-831e-549d044a4c90 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-d919bd6b-34c6-4a53-b61f-0128de675a20-delete_snapshot" released by "delete_snapshot" :: held 4.503s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Lock "cinder-quobyte-84d71ff5-6614-497a-934e-e3b4289a65b0" released by "delete_snapshot" :: held 3.913s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Created reservations ['927678da-3fa6-4851-b528-08667954992f', '718ece17-58f9-45a8-81f4-1485fbcabfc6', 'aaf5e314-c597-4324-90a8-266469e22e96', '06c28c1a-03ef-48c2-9356-f2494f79480f'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:29:24 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Delete snapshot completed successfully. Jun 25 18:29:24 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-30304634-5e15-4e4d-af28-101a8cd94e4f tempest-CinderUnicodeTest-521598722 None] Lock "cinder-2e84634d-fb04-4e06-a33c-1c08a028d716-delete_snapshot" released by "delete_snapshot" :: held 4.081s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Acquiring lock "cinder-84d71ff5-6614-497a-934e-e3b4289a65b0-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Lock "cinder-84d71ff5-6614-497a-934e-e3b4289a65b0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Acquiring lock "cinder-quobyte-84d71ff5-6614-497a-934e-e3b4289a65b0" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Lock "cinder-quobyte-84d71ff5-6614-497a-934e-e3b4289a65b0" acquired by "delete_volume" :: waited 0.018s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:25 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4c878c-c66b-488f-885a-5f9d27049d9b]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:25 devstack sudo[114660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0 Jun 25 18:29:25 devstack sudo[114660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:25 devstack sudo[114654]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 1073741824" returned: 0 in 0.990s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-ad2dec7c-6aaf-460a-9121-6d9b8ff00994-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:25 devstack sudo[114663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 Jun 25 18:29:25 devstack sudo[114663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-ad2dec7c-6aaf-460a-9121-6d9b8ff00994-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "cinder-quobyte-ad2dec7c-6aaf-460a-9121-6d9b8ff00994" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:25 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-ad2dec7c-6aaf-460a-9121-6d9b8ff00994" acquired by "delete_volume" :: waited 0.022s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:25 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae308c5c-9226-4c97-bac8-344a0771d27e]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:25 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:25 devstack sudo[114665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 Jun 25 18:29:25 devstack sudo[114665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:26 devstack sudo[114660]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0" returned: 0 in 0.895s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:26 devstack sudo[114670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0 Jun 25 18:29:26 devstack sudo[114670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:26 devstack sudo[114663]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123" returned: 0 in 0.784s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:26 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'} {{(pid=93651) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 18:29:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fad7270-93b5-467a-b5a7-f3767b6197fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123', 'volume_size': 1}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f6d89e-55c7-445a-a74b-97f43e068aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:26 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Volume volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 (624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123): created successfully Jun 25 18:29:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f6d89e-55c7-445a-a74b-97f43e068aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:26 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Flow 'volume_create_manager' (e9176a2f-5b93-44da-864a-45f0d086b8f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:29:26 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-d767c5a7-eb3b-4a95-8b7b-28241604a962 tempest-SnapshotDependencyTests-305799308 None] Created volume successfully. Jun 25 18:29:26 devstack sudo[114665]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994" returned: 0 in 0.849s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:26 devstack sudo[114676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994 Jun 25 18:29:26 devstack sudo[114676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:26 devstack sudo[114670]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:26 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-84d71ff5-6614-497a-934e-e3b4289a65b0" returned: 0 in 0.786s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Lock "cinder-quobyte-84d71ff5-6614-497a-934e-e3b4289a65b0" released by "delete_volume" :: held 1.747s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Created reservations ['62470a02-d54a-46a2-964e-2dc3cc081968', '9552b1bc-8339-4ad8-aac8-d8c9a8796d65', '800378ac-2223-4702-b193-0e7813dc3f61', '4bbc90f8-5bd2-4525-b750-1b14bb56dded'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:27 devstack sudo[114679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:29:27 devstack sudo[114679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:27 devstack sudo[114676]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-ad2dec7c-6aaf-460a-9121-6d9b8ff00994" returned: 0 in 0.651s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-quobyte-ad2dec7c-6aaf-460a-9121-6d9b8ff00994" released by "delete_volume" :: held 1.568s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Created reservations ['7048801b-96e4-4bcc-bd0a-73619f46d5f5', 'c9ce8360-1aa1-4c1e-addd-d966159c44d5', '7ad3ee20-6296-44cf-b823-5fe06f2d93f8', '5e972aea-4913-4e51-9870-bde026c35c94'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Acquiring lock "cinder-40ea39f0-4858-4539-b420-6b3b7055cdb1-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Lock "cinder-40ea39f0-4858-4539-b420-6b3b7055cdb1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:27 devstack sudo[114682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:29:27 devstack sudo[114682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Acquiring lock "cinder-quobyte-40ea39f0-4858-4539-b420-6b3b7055cdb1" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Lock "cinder-quobyte-40ea39f0-4858-4539-b420-6b3b7055cdb1" acquired by "delete_volume" :: waited 0.030s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc94711-0162-483d-8c74-d749c52e2011]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:27 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-40ea39f0-4858-4539-b420-6b3b7055cdb1 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:27 devstack sudo[114684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-40ea39f0-4858-4539-b420-6b3b7055cdb1 Jun 25 18:29:27 devstack sudo[114684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:28 devstack sudo[114679]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.044s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:28 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:29:28 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Deleted volume successfully. Jun 25 18:29:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-9f0d4775-e2f1-4e67-858b-d321ff4ddb23 tempest-CinderUnicodeTest-521598722 None] Lock "cinder-84d71ff5-6614-497a-934e-e3b4289a65b0-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:28 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] Creating offline snapshot ce26052a-bdd0-46b8-8c13-6e944bc2dd78 of volume 624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 {{(pid=93651) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 18:29:28 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ac165d-18f6-43e5-8950-3708f043aacc]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:28 devstack sudo[114682]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.020s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:28 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:29:28 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Deleted volume successfully. Jun 25 18:29:28 devstack sudo[114688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 Jun 25 18:29:28 devstack sudo[114688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:28 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ff89c658-7009-4375-a470-9afcbb54e959 tempest-CreateVolumesFromSnapshotTest-71388379 None] Lock "cinder-ad2dec7c-6aaf-460a-9121-6d9b8ff00994-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:28 devstack sudo[114684]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-40ea39f0-4858-4539-b420-6b3b7055cdb1" returned: 0 in 1.262s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:28 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-40ea39f0-4858-4539-b420-6b3b7055cdb1 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:28 devstack sudo[114694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-40ea39f0-4858-4539-b420-6b3b7055cdb1 Jun 25 18:29:28 devstack sudo[114694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:29 devstack sudo[114688]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123" returned: 0 in 1.048s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 1G {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:29 devstack sudo[114699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 1G Jun 25 18:29:29 devstack sudo[114699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:29 devstack sudo[114694]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-40ea39f0-4858-4539-b420-6b3b7055cdb1" returned: 0 in 0.775s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:29 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Lock "cinder-quobyte-40ea39f0-4858-4539-b420-6b3b7055cdb1" released by "delete_volume" :: held 2.097s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:29 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Created reservations ['62200772-f48b-467f-a489-e3723534cfde', '4cdccdc9-6bd5-4641-8db5-9c517380e9ff', '446cdb60-baad-4e6d-94b6-e631f486db21', '430a25d9-5fac-41f1-9862-d7eadeaf6cff'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:29:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:29 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:29 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:30 devstack sudo[114703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:29:30 devstack sudo[114703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:30 devstack sudo[114699]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 1G" returned: 0 in 1.081s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:30 devstack sudo[114708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 Jun 25 18:29:30 devstack sudo[114708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:30 devstack sudo[114703]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:30 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.883s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:30 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:29:30 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Deleted volume successfully. Jun 25 18:29:30 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-ecd82d02-e819-4cf9-a2f2-f1cf6dffcb1d tempest-CinderUnicodeTest-521598722 None] Lock "cinder-40ea39f0-4858-4539-b420-6b3b7055cdb1-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:31 devstack sudo[114708]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 -F qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78" returned: 0 in 0.757s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:31 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 is being set with open permissions: ugo+rw Jun 25 18:29:31 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:31 devstack sudo[114714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 Jun 25 18:29:31 devstack sudo[114714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:32 devstack sudo[114714]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78" returned: 0 in 0.849s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:32 devstack sudo[114717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.info Jun 25 18:29:32 devstack sudo[114717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:32 devstack sudo[114717]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.info" returned: 0 in 0.768s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:32 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.info is being set with open permissions: ugo+rw Jun 25 18:29:32 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.info {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:32 devstack sudo[114734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.info Jun 25 18:29:32 devstack sudo[114734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:33 devstack sudo[114734]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.info" returned: 0 in 0.695s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:33 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.351s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:33 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-bd0fe303-b12c-452e-93c6-5e46b6a30163 tempest-SnapshotDependencyTests-305799308 None] Create snapshot completed successfully Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.flows.manager.create_volume [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93651) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Flow 'volume_create_manager' (a94deb9b-8d32-40b3-b52a-b0ae66b2aa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51fe3355-e79d-4f89-98da-80f2fa1f2a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51fe3355-e79d-4f89-98da-80f2fa1f2a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T16:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e002cd34e054509b74816658e9d5851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T16:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ce26052a-bdd0-46b8-8c13-6e944bc2dd78,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T16:29:35Z,use_quota=True,user_id='baa5149fcc574e02ac1a30d194cd2208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b5ef953-86c3-4d15-8227-18d098b9db90),volume_type_id=0b5ef953-86c3-4d15-8227-18d098b9db90)' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7877fab-adfc-4dc2-95c8-cbf872afd74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7877fab-adfc-4dc2-95c8-cbf872afd74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c06deb-d367-402c-9bf7-113de65efacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c06deb-d367-402c-9bf7-113de65efacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf', 'volume_name': 'volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf', 'volume_size': 1, 'snapshot_id': 'ce26052a-bdd0-46b8-8c13-6e944bc2dd78'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c788631-b611-483b-9760-221ebce404ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c788631-b611-483b-9760-221ebce404ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0343c6db-d561-4b45-b9f9-889bccc4faa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:35 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Volume 9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf', 'volume_size': 1, 'snapshot_id': 'ce26052a-bdd0-46b8-8c13-6e944bc2dd78'} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "cinder-quobyte-ce26052a-bdd0-46b8-8c13-6e944bc2dd78-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf" by "_create_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-quobyte-ce26052a-bdd0-46b8-8c13-6e944bc2dd78-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Creating volume 9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf from snapshot ce26052a-bdd0-46b8-8c13-6e944bc2dd78 {{(pid=93651) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Selected osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139 as target Quobyte volume. {{(pid=93651) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "cinder-quobyte-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf" by "_copy_volume_from_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-quobyte-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] snapshot: ce26052a-bdd0-46b8-8c13-6e944bc2dd78, volume: 9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf, {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea240de5-f842-436e-a557-71c040097197]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:35 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:35 devstack sudo[114760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 Jun 25 18:29:35 devstack sudo[114760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:36 devstack sudo[114760]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78" returned: 0 in 0.832s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:29:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] will copy from snapshot at /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 18:29:36 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Creating direct copy from snapshot {{(pid=93651) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 18:29:36 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52143c2-b391-40bb-8239-d388574f0398]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:36 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:36 devstack sudo[114765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 Jun 25 18:29:36 devstack sudo[114765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:37 devstack sudo[114765]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123" returned: 0 in 0.777s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:37 devstack cinder-volume[93651]: DEBUG cinder.utils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Path /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf not found in is_blk_device check {{(pid=93651) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 18:29:37 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:37 devstack sudo[114770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf Jun 25 18:29:37 devstack sudo[114770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:39 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:29:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:39 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:39 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:39 devstack sudo[114783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:29:39 devstack sudo[114783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:40 devstack sudo[114783]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:40 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 1.591s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:40 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:29:40 devstack cinder-volume[93651]: DEBUG oslo_service.periodic_task [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] Running periodic task VolumeManager._thread_info {{(pid=93651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 18:29:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread count: 28 {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5827}} Jun 25 18:29:40 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-c9f0b34f-bc05-4f84-9a02-d604d14a1cad None None] thread info: [<_MainThread(MainThread, started 129316009140352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5828}} Jun 25 18:29:41 devstack sudo[114770]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf" returned: 0 in 4.831s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:41 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb5e70c-550e-4dd3-876f-21526d2812a0]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:41 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:42 devstack sudo[114787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 Jun 25 18:29:42 devstack sudo[114787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:42 devstack sudo[114787]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123" returned: 0 in 0.959s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:42 devstack cinder-volume[93651]: DEBUG cinder.image.image_utils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Image conversion details: src /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf {{(pid=93651) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 18:29:42 devstack cinder-volume[93651]: INFO cinder.image.image_utils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Converted 1024.00 MB image at 211.93 MB/s Jun 25 18:29:42 devstack cinder-volume[93651]: WARNING cinder.volume.drivers.remotefs [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf is being set with open permissions: ugo+rw Jun 25 18:29:42 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:42 devstack sudo[114792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf Jun 25 18:29:42 devstack sudo[114792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:43 devstack sudo[114792]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf" returned: 0 in 0.618s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-quobyte-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf" released by "_copy_volume_from_snapshot" :: held 8.113s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:43 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-quobyte-ce26052a-bdd0-46b8-8c13-6e944bc2dd78-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf" released by "_create_volume_from_snapshot" :: held 8.149s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:43 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.167s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0343c6db-d561-4b45-b9f9-889bccc4faa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf', 'volume_size': 1, 'snapshot_id': 'ce26052a-bdd0-46b8-8c13-6e944bc2dd78'}' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68ded23-7dc5-4240-a4b0-65f7df7be2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 18:29:43 devstack cinder-volume[93651]: INFO cinder.volume.flows.manager.create_volume [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Volume volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf (9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf): created successfully Jun 25 18:29:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68ded23-7dc5-4240-a4b0-65f7df7be2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93651) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 18:29:43 devstack cinder-volume[93651]: DEBUG cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Flow 'volume_create_manager' (a94deb9b-8d32-40b3-b52a-b0ae66b2aa1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93651) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 18:29:43 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-27bee317-98c8-405a-a281-a35a9879c43e tempest-SnapshotDependencyTests-305799308 None] Created volume successfully. Jun 25 18:29:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "cinder-ce26052a-bdd0-46b8-8c13-6e944bc2dd78-delete_snapshot" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-ce26052a-bdd0-46b8-8c13-6e944bc2dd78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "cinder-quobyte-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123" by "delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-quobyte-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "cinder-quobyte-ce26052a-bdd0-46b8-8c13-6e944bc2dd78" by "_delete_snapshot" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:44 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-quobyte-ce26052a-bdd0-46b8-8c13-6e944bc2dd78" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Deleting offline snapshot ce26052a-bdd0-46b8-8c13-6e944bc2dd78 of volume 624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 18:29:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] snapshot_file for this snap is: volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 {{(pid=93651) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 18:29:44 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c09f64-701d-4110-a406-0875eea12988]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:44 devstack sudo[114795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 Jun 25 18:29:44 devstack sudo[114795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:44 devstack sudo[114795]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78" returned: 0 in 0.728s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:44 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.remotefs [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93651) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 18:29:44 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[168a5825-3d74-466d-a3f8-045e54c7b2d4]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:44 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:45 devstack sudo[114800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 Jun 25 18:29:45 devstack sudo[114800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:45 devstack sudo[114800]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123" returned: 0 in 0.744s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:45 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:45 devstack sudo[114806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 Jun 25 18:29:45 devstack sudo[114806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:46 devstack sudo[114806]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78" returned: 0 in 0.735s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:46 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:46 devstack sudo[114811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78 Jun 25 18:29:46 devstack sudo[114811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:47 devstack sudo[114811]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:47 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123.ce26052a-bdd0-46b8-8c13-6e944bc2dd78" returned: 0 in 0.713s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-quobyte-ce26052a-bdd0-46b8-8c13-6e944bc2dd78" released by "_delete_snapshot" :: held 3.026s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-quobyte-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123" released by "delete_snapshot" :: held 3.049s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:47 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Created reservations ['f116b35e-2d58-48eb-8085-14c84cdd78ce', 'df77bbe2-e746-42e7-a133-0f106503cf9d', '30b53b0c-c108-4727-83fc-782830840baf', 'c6447c35-159e-4cfa-abc6-e5351f8a6a1e'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:29:47 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Delete snapshot completed successfully. Jun 25 18:29:47 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-64a56c25-b0ff-4bae-bfc2-7349ff25cd5b tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-ce26052a-bdd0-46b8-8c13-6e944bc2dd78-delete_snapshot" released by "delete_snapshot" :: held 3.253s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:48 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "cinder-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:48 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:48 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "cinder-quobyte-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:48 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-quobyte-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123" acquired by "delete_volume" :: waited 0.016s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:48 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[5388936f-7f15-411d-af7c-0170f7468464]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:48 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:48 devstack sudo[114821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 Jun 25 18:29:48 devstack sudo[114821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:49 devstack sudo[114821]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123" returned: 0 in 0.929s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:49 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:49 devstack sudo[114826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123 Jun 25 18:29:49 devstack sudo[114826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:50 devstack sudo[114826]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123" returned: 0 in 0.754s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-quobyte-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123" released by "delete_volume" :: held 1.751s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Created reservations ['a84caf71-32ca-4794-a5e1-87f853736b16', '7b80a3fd-d846-49f7-a32a-87af0bf40685', '31f27b57-950b-47cd-b5f3-a8c575bc1954', '821d34cd-79ae-4801-8535-dd591ac09913'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:50 devstack sudo[114829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:29:50 devstack sudo[114829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "cinder-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf-delete_volume" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "cinder-quobyte-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf" by "delete_volume" {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-quobyte-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf" acquired by "delete_volume" :: waited 0.015s {{(pid=93651) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d43fb0c-43b4-4fdd-8db6-37a1f9a5e23d]: (4, 'qcow2') {{(pid=95330) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 18:29:50 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:50 devstack sudo[114832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf Jun 25 18:29:50 devstack sudo[114832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:51 devstack sudo[114829]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.783s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:51 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:29:51 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Deleted volume successfully. Jun 25 18:29:51 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-433cd1ce-1eef-4352-a6b6-710ac11bafdd tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-624b0d8a-1a7b-4e8f-b8f0-b43b6e2ec123-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:51 devstack sudo[114832]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf" returned: 0 in 0.814s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:51 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:51 devstack sudo[114838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf Jun 25 18:29:51 devstack sudo[114838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:52 devstack sudo[114838]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05/volume-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf" returned: 0 in 0.703s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:52 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-quobyte-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf" released by "delete_volume" :: held 1.562s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:29:52 devstack cinder-volume[93651]: DEBUG cinder.quota [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Created reservations ['6205876e-8965-459f-b6d4-02a2ff83f357', 'e7a1ac9b-1dd8-4f33-b2ae-5d69df21328f', '55aa9e5d-9fd0-4838-a5dc-64dfc52cfa78', 'e2bf902d-f198-4d74-9f7e-2188148474f4'] {{(pid=93651) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 18:29:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 18:29:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 18:29:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139': None} {{(pid=93651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 18:29:52 devstack cinder-volume[93651]: DEBUG cinder.volume.drivers.quobyte [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef59dbed-3652-463c-9ce1-697f5dd2b139'] {{(pid=93651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 18:29:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.lockutils [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 18:29:52 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 18:29:52 devstack sudo[114841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05 Jun 25 18:29:52 devstack sudo[114841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 18:29:53 devstack sudo[114841]: pam_unix(sudo:session): session closed for user root Jun 25 18:29:53 devstack cinder-volume[93651]: DEBUG oslo_concurrency.processutils [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/898679d025c522dd5b9d724110daea05" returned: 0 in 0.715s {{(pid=93651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 18:29:53 devstack cinder-volume[93651]: DEBUG cinder.manager [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Notifying Schedulers of capabilities ... {{(pid=93651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 18:29:53 devstack cinder-volume[93651]: INFO cinder.volume.manager [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Deleted volume successfully. Jun 25 18:29:53 devstack cinder-volume[93651]: DEBUG cinder.coordination [None req-fd56b2fe-1363-44e5-87ae-04c3950f5d47 tempest-SnapshotDependencyTests-305799308 None] Lock "cinder-9e5313e8-c46d-4efc-8fc8-ba4588ca0ccf-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=93651) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 18:30:02 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=133,cinder:SELECT=92,cinder:INSERT=34,cinder:DELETE=11 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:30:03 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=134,cinder:SELECT=110,cinder:DELETE=13,cinder:INSERT=44 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:30:33 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:SELECT=1 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 18:30:33 devstack cinder-volume[93651]: DEBUG dbcounter [-] [93651] Writing DB stats cinder:UPDATE=1 {{(pid=93651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}